JUnit version 4.12 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskHFigEJ/java/build/jars/log4j-slf4j-impl-2.11.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskHFigEJ/java/build/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskHFigEJ/java/build/jars/logback-classic-1.0.9.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 08:29:06.035 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720146029 08:29:06.127 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:06.131 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:06.139 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:06.151 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:06.154 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:06.201 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696" hms_mode: NONE mini_kdc_options { } } 08:29:06.358 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:06.366 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:06.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:06.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:06Z Disabled control of system clock 08:29:06.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.383787 27128 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:06.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:06.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/wal 08:29:06.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/data 08:29:06.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:06.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:06.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:06.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:06.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.62:38829 08:29:06.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.62 08:29:06.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:06.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:06.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/logs 08:29:06.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/data/info.pb 08:29:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.439915 27137 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.440126 27137 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.441406 27137 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.441443 27137 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.441457 27137 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.441470 27137 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:06.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.443496 27137 master_main.cc:98] Master server non-default flags: 08:29:06.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:06.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/data 08:29:06.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/wal 08:29:06.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:06.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:06.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.62:38829 08:29:06.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:06.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:06.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/data/info.pb 08:29:06.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.62 08:29:06.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:06.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.27137 08:29:06.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:06.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:06.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/logs 08:29:06.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:06.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:06.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:06.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:06.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:06.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:06.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:06.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.452361 27137 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:06.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.453547 27137 hybrid_clock.cc:181] HybridClock initialized: now 1573720146453483 us; error 67 us; skew 500 ppm 08:29:06.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.454020 27137 fs_manager.cc:261] Metadata directory not provided 08:29:06.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.454063 27137 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:06.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.454277 27137 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:06.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.454293 27137 server_base.cc:453] Attempting to create new FS layout instead 08:29:06.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.456113 27137 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/data/instance: 08:29:06.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "88f1eceb47a749fe8ae4c94387d831a2" 08:29:06.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.456355 27137 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/wal/instance: 08:29:06.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "88f1eceb47a749fe8ae4c94387d831a2" 08:29:06.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.461191 27137 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s 08:29:06.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.461885 27137 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:06.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.462391 27137 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:06.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.465306 27137 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:06.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.465386 27137 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/wal 08:29:06.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "88f1eceb47a749fe8ae4c94387d831a2" 08:29:06.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.465490 27137 fs_report.cc:352] FS layout report 08:29:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/wal 08:29:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/wal 08:29:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/data/data 08:29:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:06.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:06.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:06.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:06.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:06.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:06.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:06.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:06.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.489327 27137 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:06.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.494295 27137 rpc_server.cc:211] RPC server started. Bound to: 127.26.126.62:38829 08:29:06.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.495015 27137 webserver.cc:382] Webserver started at http://127.26.126.62:43485/ using document root and password file 08:29:06.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.495481 27137 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-0/data/info.pb 08:29:06.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.497895 27199 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.501122 27199 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.501273 27128 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 27137 08:29:06.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.501847 27128 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:06.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:06.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/wal 08:29:06.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/data 08:29:06.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.61:40495 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.61 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/logs 08:29:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/data/info.pb 08:29:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:06.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.520864 27199 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.521622 27199 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.26.126.61:40495: Network error: Client connection negotiation failed: client connection to 127.26.126.61:40495: connect: Connection refused (error 111) 08:29:06.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.540891 27199 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } attempt: 1 08:29:06.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.541821 27199 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.26.126.61:40495: Network error: Client connection negotiation failed: client connection to 127.26.126.61:40495: connect: Connection refused (error 111) 08:29:06.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:06.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.561265 27200 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:06.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.561458 27200 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:06.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.562736 27200 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:06.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.562781 27200 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:06.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.562796 27200 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:06.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.562811 27200 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:06.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.565367 27200 master_main.cc:98] Master server non-default flags: 08:29:06.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/data 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/wal 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.61:40495 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/data/info.pb 08:29:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.61 08:29:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.27200 08:29:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/logs 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:06.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:06.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.574270 27200 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:06.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.575459 27200 hybrid_clock.cc:181] HybridClock initialized: now 1573720146575406 us; error 54 us; skew 500 ppm 08:29:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.576081 27200 fs_manager.cc:261] Metadata directory not provided 08:29:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.576144 27200 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.576460 27200 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.576491 27200 server_base.cc:453] Attempting to create new FS layout instead 08:29:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.578454 27200 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/data/instance: 08:29:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "44e16c40abbd41e08afd8f96932a9551" 08:29:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.578785 27200 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/wal/instance: 08:29:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "44e16c40abbd41e08afd8f96932a9551" 08:29:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.583708 27200 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s 08:29:06.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.584353 27200 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:06.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.584856 27200 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:06.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.587730 27200 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.587831 27200 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/wal 08:29:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "44e16c40abbd41e08afd8f96932a9551" 08:29:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.587937 27200 fs_report.cc:352] FS layout report 08:29:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/wal 08:29:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/wal 08:29:06.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/data/data 08:29:06.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:06.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:06.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:06.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:06.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:06.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:06.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:06.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:06.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:06.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:06.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.590006 27199 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } attempt: 2 08:29:06.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.591259 27199 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.26.126.61:40495: Network error: Client connection negotiation failed: client connection to 127.26.126.61:40495: connect: Connection refused (error 111) 08:29:06.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.630287 27200 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:06.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.636384 27200 rpc_server.cc:211] RPC server started. Bound to: 127.26.126.61:40495 08:29:06.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.637642 27200 webserver.cc:382] Webserver started at http://127.26.126.61:37825/ using document root and password file 08:29:06.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.638352 27200 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-1/data/info.pb 08:29:06.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.641356 27263 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:06.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.645331 27263 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.648475 27128 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 27200 08:29:06.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.649051 27128 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:06.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:06.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/wal 08:29:06.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/data 08:29:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.60:35489 08:29:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.60 08:29:06.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:06.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:06.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/logs 08:29:06.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/data/info.pb 08:29:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:06.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.655797 27263 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.661247 27263 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.661932 27263 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.26.126.60:35489: Network error: Client connection negotiation failed: client connection to 127.26.126.60:35489: connect: Connection refused (error 111) 08:29:06.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.681154 27263 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } attempt: 1 08:29:06.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.682322 27263 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.26.126.60:35489: Network error: Client connection negotiation failed: client connection to 127.26.126.60:35489: connect: Connection refused (error 111) 08:29:06.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.702467 27199 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } attempt: 3 08:29:06.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.706662 27199 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.707374 27199 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.26.126.60:35489: Network error: Client connection negotiation failed: client connection to 127.26.126.60:35489: connect: Connection refused (error 111) 08:29:06.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:06.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.712564 27265 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:06.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.712839 27265 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:06.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.713800 27265 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:06.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.713827 27265 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:06.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.713835 27265 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:06.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.713843 27265 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:06.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.715761 27265 master_main.cc:98] Master server non-default flags: 08:29:06.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/data 08:29:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/wal 08:29:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.60:35489 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/data/info.pb 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.60 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.27265 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/logs 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:06.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.723855 27265 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:06.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.725044 27265 hybrid_clock.cc:181] HybridClock initialized: now 1573720146725000 us; error 42 us; skew 500 ppm 08:29:06.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.725615 27265 fs_manager.cc:261] Metadata directory not provided 08:29:06.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.725661 27265 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:06.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.725899 27265 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:06.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.725917 27265 server_base.cc:453] Attempting to create new FS layout instead 08:29:06.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.728024 27265 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/data/instance: 08:29:06.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" 08:29:06.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.728269 27265 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/wal/instance: 08:29:06.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" 08:29:06.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.730500 27263 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } attempt: 2 08:29:06.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.731611 27263 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.26.126.60:35489: Network error: Client connection negotiation failed: client connection to 127.26.126.60:35489: connect: Connection refused (error 111) 08:29:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.734010 27265 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s 08:29:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.734638 27265 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:06.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.735087 27265 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.738328 27265 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.738423 27265 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/wal 08:29:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" 08:29:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.738505 27265 fs_report.cc:352] FS layout report 08:29:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/wal 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/wal 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/data/data 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:06.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:06.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.771625 27199 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } attempt: 1 08:29:06.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.772850 27199 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.26.126.60:35489: Network error: Client connection negotiation failed: client connection to 127.26.126.60:35489: connect: Connection refused (error 111) 08:29:06.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.783782 27265 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:06.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.789069 27265 rpc_server.cc:211] RPC server started. Bound to: 127.26.126.60:35489 08:29:06.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.789880 27265 webserver.cc:382] Webserver started at http://127.26.126.60:34321/ using document root and password file 08:29:06.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.790429 27265 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/master-2/data/info.pb 08:29:06.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.793092 27328 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:06.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.794298 27128 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 27265 08:29:06.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.795039 27128 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:06.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:06.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/wal 08:29:06.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/data 08:29:06.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:06.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.1:0 08:29:06.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.26.126.1 08:29:06.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.1 08:29:06.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:06.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:06.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/logs 08:29:06.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/data/info.pb 08:29:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:06.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.797552 27328 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.808435 27328 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.812391 27328 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } has no permanent_uuid. Determining permanent_uuid... 08:29:06.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.819255 27328 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff: Bootstrap starting. 08:29:06.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.821146 27328 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff: No blocks or log segments found. Creating new log. 08:29:06.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.821974 27328 log.cc:558] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff: Log is configured to *not* fsync() on all Append() calls 08:29:06.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.823539 27328 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff: No bootstrap required, opened a new log 08:29:06.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.825858 27328 raft_consensus.cc:333] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.825942 27328 raft_consensus.cc:359] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:06.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.825984 27328 raft_consensus.cc:698] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45db07a3c5d64d6ebff3eab7b077d7ff, State: Initialized, Role: FOLLOWER 08:29:06.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.826524 27328 consensus_queue.cc:228] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.826920 27328 sys_catalog.cc:340] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:06.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.826958 27328 sys_catalog.cc:343] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: This master's current role is: FOLLOWER 08:29:06.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.827024 27333 sys_catalog.cc:340] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:06.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.827045 27333 sys_catalog.cc:343] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: This master's current role is: FOLLOWER 08:29:06.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.827674 27328 sys_catalog.cc:428] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: configured and running, proceeding with master startup. 08:29:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.830302 27334 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.830341 27334 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:06.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.842828 27263 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } attempt: 3 08:29:06.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.850816 27263 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551: Bootstrap starting. 08:29:06.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.852063 27199 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } attempt: 2 08:29:06.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.853466 27263 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551: No blocks or log segments found. Creating new log. 08:29:06.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.854455 27263 log.cc:558] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551: Log is configured to *not* fsync() on all Append() calls 08:29:06.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.857054 27263 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551: No bootstrap required, opened a new log 08:29:06.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:06.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.857406 27329 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:06.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.857638 27329 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:06.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.858817 27329 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:06.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.858892 27329 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.126.1 08:29:06.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.859496 27199 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2: Bootstrap starting. 08:29:06.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.861165 27329 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:06.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:06.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/data 08:29:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/wal 08:29:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.1:0 08:29:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/data/info.pb 08:29:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.1 08:29:06.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.27329 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.26.126.1 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/logs 08:29:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.861676 27263 raft_consensus.cc:333] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.861685 27199 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2: No blocks or log segments found. Creating new log. 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.861754 27263 raft_consensus.cc:359] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.861796 27263 raft_consensus.cc:698] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44e16c40abbd41e08afd8f96932a9551, State: Initialized, Role: FOLLOWER 08:29:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.862627 27199 log.cc:558] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2: Log is configured to *not* fsync() on all Append() calls 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.863492 27263 consensus_queue.cc:228] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.863888 27263 sys_catalog.cc:340] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.863930 27263 sys_catalog.cc:343] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: This master's current role is: FOLLOWER 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.865442 27341 sys_catalog.cc:340] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.865478 27341 sys_catalog.cc:343] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: This master's current role is: FOLLOWER 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.865955 27199 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2: No bootstrap required, opened a new log 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.869254 27199 raft_consensus.cc:333] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.869333 27199 raft_consensus.cc:359] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.869374 27199 raft_consensus.cc:698] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f1eceb47a749fe8ae4c94387d831a2, State: Initialized, Role: FOLLOWER 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.869921 27199 consensus_queue.cc:228] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.870312 27199 sys_catalog.cc:340] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:06.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.870342 27199 sys_catalog.cc:343] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: This master's current role is: FOLLOWER 08:29:06.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.871268 27199 sys_catalog.cc:428] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: configured and running, proceeding with master startup. 08:29:06.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.871796 27329 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:06.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.872961 27342 sys_catalog.cc:340] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:06.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.872980 27342 sys_catalog.cc:343] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: This master's current role is: FOLLOWER 08:29:06.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.875185 27343 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:06.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.875207 27343 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:06.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.876499 27342 raft_consensus.cc:465] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.876703 27342 raft_consensus.cc:487] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.878154 27342 leader_election.cc:296] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44e16c40abbd41e08afd8f96932a9551 (127.26.126.61:40495), 45db07a3c5d64d6ebff3eab7b077d7ff (127.26.126.60:35489) 08:29:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.879379 27305 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f1eceb47a749fe8ae4c94387d831a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" is_pre_election: true 08:29:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.879616 27305 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f1eceb47a749fe8ae4c94387d831a2 in term 0. 08:29:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.880136 27146 leader_election.cc:310] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45db07a3c5d64d6ebff3eab7b077d7ff, 88f1eceb47a749fe8ae4c94387d831a2; no voters: 08:29:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.880504 27342 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.880560 27342 raft_consensus.cc:465] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.880596 27342 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 0 FOLLOWER]: Advancing to term 1 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.881572 27263 sys_catalog.cc:428] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: configured and running, proceeding with master startup. 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.881623 27239 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f1eceb47a749fe8ae4c94387d831a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44e16c40abbd41e08afd8f96932a9551" is_pre_election: true 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.881814 27239 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f1eceb47a749fe8ae4c94387d831a2 in term 0. 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.881996 27342 raft_consensus.cc:487] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.882319 27342 leader_election.cc:296] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [CANDIDATE]: Term 1 election: Requested vote from peers 44e16c40abbd41e08afd8f96932a9551 (127.26.126.61:40495), 45db07a3c5d64d6ebff3eab7b077d7ff (127.26.126.60:35489) 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.883005 27305 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f1eceb47a749fe8ae4c94387d831a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.883066 27305 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [term 0 FOLLOWER]: Advancing to term 1 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.884272 27305 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f1eceb47a749fe8ae4c94387d831a2 in term 1. 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.884469 27219 tablet.cc:1764] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.884670 27347 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:06.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.884697 27347 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:06.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.885125 27239 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f1eceb47a749fe8ae4c94387d831a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44e16c40abbd41e08afd8f96932a9551" 08:29:06.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.885195 27239 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [term 0 FOLLOWER]: Advancing to term 1 08:29:06.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.886162 27239 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f1eceb47a749fe8ae4c94387d831a2 in term 1. 08:29:06.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.886497 27146 leader_election.cc:310] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44e16c40abbd41e08afd8f96932a9551, 88f1eceb47a749fe8ae4c94387d831a2; no voters: 08:29:06.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.886714 27342 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 1 FOLLOWER]: Leader election won for term 1 08:29:06.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.887019 27342 raft_consensus.cc:660] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [term 1 LEADER]: Becoming Leader. State: Replica: 88f1eceb47a749fe8ae4c94387d831a2, State: Running, Role: LEADER 08:29:06.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.887717 27342 consensus_queue.cc:205] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } 08:29:06.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.890398 27349 sys_catalog.cc:340] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f1eceb47a749fe8ae4c94387d831a2. Latest consensus state: current_term: 1 leader_uuid: "88f1eceb47a749fe8ae4c94387d831a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:06.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.890434 27349 sys_catalog.cc:343] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: This master's current role is: LEADER 08:29:06.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.898583 27351 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:06.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.899999 27351 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:06.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.903800 27329 hybrid_clock.cc:181] HybridClock initialized: now 1573720146903726 us; error 56 us; skew 500 ppm 08:29:06.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.904703 27329 fs_manager.cc:261] Metadata directory not provided 08:29:06.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.904816 27329 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.905167 27329 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.905200 27329 server_base.cc:453] Attempting to create new FS layout instead 08:29:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.908012 27329 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/data/instance: 08:29:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "155671c7bf4c46dd981a3ae121047f5d" 08:29:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.908370 27329 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/wal/instance: 08:29:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "155671c7bf4c46dd981a3ae121047f5d" 08:29:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.918479 27329 fs_manager.cc:508] Time spent creating directory manager: real 0.010s user 0.009s sys 0.000s 08:29:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.919437 27329 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.920043 27329 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:06.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.925561 27329 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.925766 27329 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/wal 08:29:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "155671c7bf4c46dd981a3ae121047f5d" 08:29:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:06 on dist-test-slave-dist-test-slave-05kx" 08:29:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.925902 27329 fs_report.cc:352] FS layout report 08:29:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/wal 08:29:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/wal 08:29:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/data/data 08:29:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:06.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:06.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:06.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:06.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.973804 27329 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:06.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.974808 27329 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:06.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.974838 27329 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:06.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.983642 27329 rpc_server.cc:211] RPC server started. Bound to: 127.26.126.1:42793 08:29:06.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.984378 27329 webserver.cc:382] Webserver started at http://127.26.126.1:45693/ using document root and password file 08:29:06.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.984881 27329 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-0/data/info.pb 08:29:06.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:06.991243 27155 tablet.cc:1764] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:06.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.992189 27128 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 27329 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.992833 27128 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/wal 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/data 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.2:0 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.26.126.2 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.2 08:29:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/logs 08:29:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/data/info.pb 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.996577 27468 heartbeater.cc:322] Connected to a master server at 127.26.126.60:35489 08:29:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.996734 27468 heartbeater.cc:406] Registering TS with master... 08:29:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.997232 27468 heartbeater.cc:455] Master 127.26.126.60:35489 requested a full tablet report, sending... 08:29:06.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.998458 27469 heartbeater.cc:322] Connected to a master server at 127.26.126.61:40495 08:29:07.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.998505 27469 heartbeater.cc:406] Registering TS with master... 08:29:07.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.998625 27469 heartbeater.cc:455] Master 127.26.126.61:40495 requested a full tablet report, sending... 08:29:07.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.998713 27295 ts_manager.cc:191] Registered new tserver with Master: 155671c7bf4c46dd981a3ae121047f5d (127.26.126.1:42793) 08:29:07.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.999068 27470 heartbeater.cc:322] Connected to a master server at 127.26.126.62:38829 08:29:07.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.999142 27470 heartbeater.cc:406] Registering TS with master... 08:29:07.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.999344 27470 heartbeater.cc:455] Master 127.26.126.62:38829 requested a full tablet report, sending... 08:29:07.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:06.999522 27230 ts_manager.cc:191] Registered new tserver with Master: 155671c7bf4c46dd981a3ae121047f5d (127.26.126.1:42793) 08:29:07.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.000425 27166 ts_manager.cc:191] Registered new tserver with Master: 155671c7bf4c46dd981a3ae121047f5d (127.26.126.1:42793) 08:29:07.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.035238 27284 tablet.cc:1764] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:07.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.076745 27239 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [term 1 FOLLOWER]: Refusing update from remote peer 88f1eceb47a749fe8ae4c94387d831a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:07.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.076879 27305 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [term 1 FOLLOWER]: Refusing update from remote peer 88f1eceb47a749fe8ae4c94387d831a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:07.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.077757 27342 consensus_queue.cc:981] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:07.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.077874 27349 consensus_queue.cc:981] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:07.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.081995 27333 sys_catalog.cc:340] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f1eceb47a749fe8ae4c94387d831a2. Latest consensus state: current_term: 1 leader_uuid: "88f1eceb47a749fe8ae4c94387d831a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:07.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.082033 27333 sys_catalog.cc:343] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: This master's current role is: FOLLOWER 08:29:07.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.082630 27341 sys_catalog.cc:340] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f1eceb47a749fe8ae4c94387d831a2. Latest consensus state: current_term: 1 leader_uuid: "88f1eceb47a749fe8ae4c94387d831a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:07.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.082684 27341 sys_catalog.cc:343] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: This master's current role is: FOLLOWER 08:29:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.085276 27349 sys_catalog.cc:340] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "88f1eceb47a749fe8ae4c94387d831a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.085312 27349 sys_catalog.cc:343] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: This master's current role is: LEADER 08:29:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.085490 27349 sys_catalog.cc:340] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "88f1eceb47a749fe8ae4c94387d831a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.085515 27349 sys_catalog.cc:343] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2 [sys.catalog]: This master's current role is: LEADER 08:29:07.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.085970 27341 sys_catalog.cc:340] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "88f1eceb47a749fe8ae4c94387d831a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:07.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.086002 27341 sys_catalog.cc:343] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551 [sys.catalog]: This master's current role is: FOLLOWER 08:29:07.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.086498 27478 mvcc.cc:203] Tried to move safe_time back from 6445957722416992256 to 6445957721654816768. Current Snapshot: MvccSnapshot[committed={T|T < 6445957722416992256}] 08:29:07.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.087865 27351 catalog_manager.cc:985] Generated new certificate authority record 08:29:07.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.088418 27333 sys_catalog.cc:340] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "88f1eceb47a749fe8ae4c94387d831a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f1eceb47a749fe8ae4c94387d831a2" member_type: VOTER last_known_addr { host: "127.26.126.62" port: 38829 } } peers { permanent_uuid: "44e16c40abbd41e08afd8f96932a9551" member_type: VOTER last_known_addr { host: "127.26.126.61" port: 40495 } } peers { permanent_uuid: "45db07a3c5d64d6ebff3eab7b077d7ff" member_type: VOTER last_known_addr { host: "127.26.126.60" port: 35489 } } } 08:29:07.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.088457 27333 sys_catalog.cc:343] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff [sys.catalog]: This master's current role is: FOLLOWER 08:29:07.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.089175 27351 catalog_manager.cc:1110] Loading token signing keys... 08:29:07.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.093364 27477 mvcc.cc:203] Tried to move safe_time back from 6445957722416992256 to 6445957721654816768. Current Snapshot: MvccSnapshot[committed={T|T < 6445957722416992256}] 08:29:07.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.101653 27351 catalog_manager.cc:4455] T 00000000000000000000000000000000 P 88f1eceb47a749fe8ae4c94387d831a2: Generated new TSK 0 08:29:07.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.102324 27351 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:07.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:07.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.193097 27475 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:07.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.193400 27475 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:07.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.194743 27475 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:07.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.194805 27475 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.126.2 08:29:07.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.196691 27475 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/data 08:29:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/wal 08:29:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.2:0 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/data/info.pb 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.2 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.27475 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:07.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:07.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:07.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:07.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.26.126.2 08:29:07.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/logs 08:29:07.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:07.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:07.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:07.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:07.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:07.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:07.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:07.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:07.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.235167 27475 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:07.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.236388 27475 hybrid_clock.cc:181] HybridClock initialized: now 1573720147236324 us; error 65 us; skew 500 ppm 08:29:07.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.237169 27475 fs_manager.cc:261] Metadata directory not provided 08:29:07.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.237237 27475 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:07.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.237530 27475 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:07.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.237562 27475 server_base.cc:453] Attempting to create new FS layout instead 08:29:07.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.240171 27475 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/data/instance: 08:29:07.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5cd07da2ac2746488edfc601b7c87536" 08:29:07.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:07 on dist-test-slave-dist-test-slave-05kx" 08:29:07.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.240511 27475 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/wal/instance: 08:29:07.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5cd07da2ac2746488edfc601b7c87536" 08:29:07.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:07 on dist-test-slave-dist-test-slave-05kx" 08:29:07.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.247053 27475 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s 08:29:07.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.247678 27475 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:07.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.248107 27475 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.251083 27475 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.251194 27475 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/wal 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5cd07da2ac2746488edfc601b7c87536" 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:07 on dist-test-slave-dist-test-slave-05kx" 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.251272 27475 fs_report.cc:352] FS layout report 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/wal 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/wal 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/data/data 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.295246 27475 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.296545 27475 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.296576 27475 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.305460 27475 rpc_server.cc:211] RPC server started. Bound to: 127.26.126.2:42659 08:29:07.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.307116 27475 webserver.cc:382] Webserver started at http://127.26.126.2:43249/ using document root and password file 08:29:07.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.307672 27475 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-1/data/info.pb 08:29:07.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.313902 27128 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 27475 08:29:07.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.314411 27128 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:07.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:07.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/wal 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/data 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.3:0 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.26.126.3 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.3 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/logs 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/data/info.pb 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:07.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:07.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:07.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:07.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:07.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:07.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.318349 27606 heartbeater.cc:322] Connected to a master server at 127.26.126.60:35489 08:29:07.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.318550 27606 heartbeater.cc:406] Registering TS with master... 08:29:07.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.319115 27606 heartbeater.cc:455] Master 127.26.126.60:35489 requested a full tablet report, sending... 08:29:07.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.319314 27607 heartbeater.cc:322] Connected to a master server at 127.26.126.61:40495 08:29:07.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.319705 27607 heartbeater.cc:406] Registering TS with master... 08:29:07.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.319934 27607 heartbeater.cc:455] Master 127.26.126.61:40495 requested a full tablet report, sending... 08:29:07.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.318353 27608 heartbeater.cc:322] Connected to a master server at 127.26.126.62:38829 08:29:07.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.320135 27608 heartbeater.cc:406] Registering TS with master... 08:29:07.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.320279 27608 heartbeater.cc:455] Master 127.26.126.62:38829 requested a full tablet report, sending... 08:29:07.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.320917 27166 ts_manager.cc:191] Registered new tserver with Master: 5cd07da2ac2746488edfc601b7c87536 (127.26.126.2:42659) 08:29:07.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.320943 27295 ts_manager.cc:191] Registered new tserver with Master: 5cd07da2ac2746488edfc601b7c87536 (127.26.126.2:42659) 08:29:07.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.321841 27230 ts_manager.cc:191] Registered new tserver with Master: 5cd07da2ac2746488edfc601b7c87536 (127.26.126.2:42659) 08:29:07.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.322489 27166 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.26.126.2:38041 08:29:07.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:07.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.369101 27613 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:07.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.369313 27613 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.370162 27613 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:07.370219 27613 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.126.3 08:29:07.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.371788 27613 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.26.126.20:35297 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/data 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/wal 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.26.126.3:0 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/data/info.pb 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.26.126.3 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.26.126.62:38829,127.26.126.61:40495,127.26.126.60:35489 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.27613 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.26.126.3 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/logs 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:07.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.379709 27613 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:07.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.380861 27613 hybrid_clock.cc:181] HybridClock initialized: now 1573720147380828 us; error 36 us; skew 500 ppm 08:29:07.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.381340 27613 fs_manager.cc:261] Metadata directory not provided 08:29:07.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.381382 27613 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:07.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.381629 27613 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:07.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.381649 27613 server_base.cc:453] Attempting to create new FS layout instead 08:29:07.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.383500 27613 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/data/instance: 08:29:07.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "800c7a6c7a1343dc98e290b54f801242" 08:29:07.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:07 on dist-test-slave-dist-test-slave-05kx" 08:29:07.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.383759 27613 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/wal/instance: 08:29:07.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "800c7a6c7a1343dc98e290b54f801242" 08:29:07.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:07 on dist-test-slave-dist-test-slave-05kx" 08:29:07.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.388690 27613 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s 08:29:07.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.389497 27613 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:07.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.389955 27613 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:07.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.392825 27613 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.392943 27613 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/wal 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "800c7a6c7a1343dc98e290b54f801242" 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:07 on dist-test-slave-dist-test-slave-05kx" 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.393054 27613 fs_report.cc:352] FS layout report 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/wal 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/wal 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/data/data 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:07.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.421243 27613 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:07.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.422654 27613 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:07.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.422688 27613 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.430884 27613 rpc_server.cc:211] RPC server started. Bound to: 127.26.126.3:38727 08:29:07.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.431717 27613 webserver.cc:382] Webserver started at http://127.26.126.3:43989/ using document root and password file 08:29:07.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.432220 27613 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5039877391620917696/ts-2/data/info.pb 08:29:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.439687 27128 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 27613 08:29:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442227 27736 heartbeater.cc:322] Connected to a master server at 127.26.126.61:40495 08:29:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442286 27735 heartbeater.cc:322] Connected to a master server at 127.26.126.60:35489 08:29:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442394 27736 heartbeater.cc:406] Registering TS with master... 08:29:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442394 27735 heartbeater.cc:406] Registering TS with master... 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442528 27737 heartbeater.cc:322] Connected to a master server at 127.26.126.62:38829 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442566 27737 heartbeater.cc:406] Registering TS with master... 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442950 27737 heartbeater.cc:455] Master 127.26.126.62:38829 requested a full tablet report, sending... 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442951 27735 heartbeater.cc:455] Master 127.26.126.60:35489 requested a full tablet report, sending... 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.442952 27736 heartbeater.cc:455] Master 127.26.126.61:40495 requested a full tablet report, sending... 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.444015 27166 ts_manager.cc:191] Registered new tserver with Master: 800c7a6c7a1343dc98e290b54f801242 (127.26.126.3:38727) 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.444087 27295 ts_manager.cc:191] Registered new tserver with Master: 800c7a6c7a1343dc98e290b54f801242 (127.26.126.3:38727) 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.444219 27230 ts_manager.cc:191] Registered new tserver with Master: 800c7a6c7a1343dc98e290b54f801242 (127.26.126.3:38727) 08:29:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.445241 27166 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.26.126.3:34851 08:29:07.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.461783 27128 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:07.461 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:07.463 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:07.467 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.26.126.62" port: 38829 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.26.126.61" port: 40495 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.26.126.60" port: 35489 } } } 08:29:07.475 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:07.476 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.26.126.1" port: 42793 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.26.126.2" port: 42659 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.26.126.3" port: 38727 } } } 08:29:07.478 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:07.577 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:07.809 [DEBUG - New I/O worker #1] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.26.126.61 08:29:07.809 [DEBUG - New I/O worker #2] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.26.126.60 08:29:07.809 [DEBUG - New I/O worker #3] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.26.126.62 08:29:07.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.834444 27334 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff: acquiring CA information for follower catalog manager: success 08:29:07.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.835958 27334 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 45db07a3c5d64d6ebff3eab7b077d7ff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.889240 27347 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551: acquiring CA information for follower catalog manager: success 08:29:07.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:07.891218 27347 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 44e16c40abbd41e08afd8f96932a9551: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:07.927 [DEBUG - New I/O worker #3] (Negotiator.java:764) Authenticated connection [id: 0x3f9f434f, /127.0.0.1:33516 => /127.26.126.62:38829] using SASL/PLAIN 08:29:07.927 [DEBUG - New I/O worker #2] (Negotiator.java:764) Authenticated connection [id: 0x37ea7379, /127.0.0.1:58468 => /127.26.126.60:35489] using SASL/PLAIN 08:29:07.931 [DEBUG - New I/O worker #1] (Negotiator.java:764) Authenticated connection [id: 0x18fc4fb1, /127.0.0.1:39970 => /127.26.126.61:40495] using SASL/PLAIN 08:29:07.965 [DEBUG - New I/O worker #3] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:07.966 [DEBUG - New I/O worker #3] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=293), Traces: [0ms] refreshing cache from master, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.26.126.61:40495, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.26.126.60:35489, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.26.126.62:38829, [260ms] Sub RPC ConnectToMaster: received response from server master-127.26.126.60:35489: OK, [260ms] Sub RPC ConnectToMaster: received response from server master-127.26.126.62:38829: OK, [260ms] Sub RPC ConnectToMaster: received response from server master-127.26.126.61:40495: OK, deferred=null) after lookup 08:29:08.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.002920 27166 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.26.126.1:49339 08:29:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.085180 27166 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33516: 08:29:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:08.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:08.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:08.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:08.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:08.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:08.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:08.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:08.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.086861 27166 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:08.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.114586 27538 tablet_service.cc:1023] Processing CreateTablet for tablet 21918702d7c347c585131471624ac811 (table=org.apache.kudu.client.TestAsyncKuduSession [id=ae48c963feb14805998f661656977038]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:08.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.115190 27538 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 21918702d7c347c585131471624ac811. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:08.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.116228 27405 tablet_service.cc:1023] Processing CreateTablet for tablet 21918702d7c347c585131471624ac811 (table=org.apache.kudu.client.TestAsyncKuduSession [id=ae48c963feb14805998f661656977038]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:08.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.116228 27672 tablet_service.cc:1023] Processing CreateTablet for tablet 21918702d7c347c585131471624ac811 (table=org.apache.kudu.client.TestAsyncKuduSession [id=ae48c963feb14805998f661656977038]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:08.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.116811 27405 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 21918702d7c347c585131471624ac811. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:08.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.116829 27672 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 21918702d7c347c585131471624ac811. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:08.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.123466 27767 tablet_bootstrap.cc:439] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536: Bootstrap starting. 08:29:08.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.125707 27767 tablet_bootstrap.cc:590] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536: No blocks or log segments found. Creating new log. 08:29:08.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.126716 27767 log.cc:558] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536: Log is configured to *not* fsync() on all Append() calls 08:29:08.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.127614 27769 tablet_bootstrap.cc:439] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d: Bootstrap starting. 08:29:08.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.129663 27769 tablet_bootstrap.cc:590] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d: No blocks or log segments found. Creating new log. 08:29:08.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.130517 27769 log.cc:558] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d: Log is configured to *not* fsync() on all Append() calls 08:29:08.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.131398 27768 tablet_bootstrap.cc:439] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242: Bootstrap starting. 08:29:08.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.133170 27768 tablet_bootstrap.cc:590] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242: No blocks or log segments found. Creating new log. 08:29:08.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.134109 27768 log.cc:558] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242: Log is configured to *not* fsync() on all Append() calls 08:29:08.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.135686 27768 tablet_bootstrap.cc:439] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242: No bootstrap required, opened a new log 08:29:08.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.135900 27768 ts_tablet_manager.cc:1096] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s 08:29:08.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.137523 27769 tablet_bootstrap.cc:439] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d: No bootstrap required, opened a new log 08:29:08.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.137714 27769 ts_tablet_manager.cc:1096] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s 08:29:08.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.137856 27767 tablet_bootstrap.cc:439] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536: No bootstrap required, opened a new log 08:29:08.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.138015 27767 ts_tablet_manager.cc:1096] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s 08:29:08.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.140897 27767 raft_consensus.cc:333] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.141008 27767 raft_consensus.cc:359] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:08.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.141055 27767 raft_consensus.cc:698] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cd07da2ac2746488edfc601b7c87536, State: Initialized, Role: FOLLOWER 08:29:08.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.141598 27767 consensus_queue.cc:228] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.136 [DEBUG - New I/O worker #3] (AsyncKuduClient.java:777) Opened table ae48c963feb14805998f661656977038 08:29:08.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.142778 27768 raft_consensus.cc:333] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.144834 27608 heartbeater.cc:447] Master 127.26.126.62:38829 was elected leader, sending a full tablet report... 08:29:08.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.147622 27767 ts_tablet_manager.cc:1124] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s 08:29:08.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.148613 27768 raft_consensus.cc:359] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:08.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.148869 27768 raft_consensus.cc:698] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800c7a6c7a1343dc98e290b54f801242, State: Initialized, Role: FOLLOWER 08:29:08.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.149399 27768 consensus_queue.cc:228] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.149904 27769 raft_consensus.cc:333] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.150332 27769 raft_consensus.cc:359] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:08.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.150584 27769 raft_consensus.cc:698] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155671c7bf4c46dd981a3ae121047f5d, State: Initialized, Role: FOLLOWER 08:29:08.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.152086 27737 heartbeater.cc:447] Master 127.26.126.62:38829 was elected leader, sending a full tablet report... 08:29:08.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.154528 27768 ts_tablet_manager.cc:1124] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s 08:29:08.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.155154 27769 consensus_queue.cc:228] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.155983 27470 heartbeater.cc:447] Master 127.26.126.62:38829 was elected leader, sending a full tablet report... 08:29:08.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.157562 27769 ts_tablet_manager.cc:1124] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s 08:29:08.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.163163 27775 raft_consensus.cc:465] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:08.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.163590 27775 raft_consensus.cc:487] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.165732 27775 leader_election.cc:296] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cd07da2ac2746488edfc601b7c87536 (127.26.126.2:42659), 800c7a6c7a1343dc98e290b54f801242 (127.26.126.3:38727) 08:29:08.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.174592 27556 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "21918702d7c347c585131471624ac811" candidate_uuid: "155671c7bf4c46dd981a3ae121047f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cd07da2ac2746488edfc601b7c87536" is_pre_election: true 08:29:08.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.174860 27556 raft_consensus.cc:2355] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155671c7bf4c46dd981a3ae121047f5d in term 0. 08:29:08.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.175956 27355 leader_election.cc:310] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155671c7bf4c46dd981a3ae121047f5d, 5cd07da2ac2746488edfc601b7c87536; no voters: 08:29:08.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.177204 27775 raft_consensus.cc:2649] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:08.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.177261 27775 raft_consensus.cc:465] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:08.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.177289 27775 raft_consensus.cc:2901] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 0 FOLLOWER]: Advancing to term 1 08:29:08.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.178396 27775 raft_consensus.cc:487] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.178884 27775 leader_election.cc:296] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [CANDIDATE]: Term 1 election: Requested vote from peers 5cd07da2ac2746488edfc601b7c87536 (127.26.126.2:42659), 800c7a6c7a1343dc98e290b54f801242 (127.26.126.3:38727) 08:29:08.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.179198 27556 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "21918702d7c347c585131471624ac811" candidate_uuid: "155671c7bf4c46dd981a3ae121047f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cd07da2ac2746488edfc601b7c87536" 08:29:08.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.179270 27556 raft_consensus.cc:2901] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536 [term 0 FOLLOWER]: Advancing to term 1 08:29:08.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.180429 27556 raft_consensus.cc:2355] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155671c7bf4c46dd981a3ae121047f5d in term 1. 08:29:08.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.180560 27692 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "21918702d7c347c585131471624ac811" candidate_uuid: "155671c7bf4c46dd981a3ae121047f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800c7a6c7a1343dc98e290b54f801242" is_pre_election: true 08:29:08.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.180745 27692 raft_consensus.cc:2355] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155671c7bf4c46dd981a3ae121047f5d in term 0. 08:29:08.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.180763 27355 leader_election.cc:310] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155671c7bf4c46dd981a3ae121047f5d, 5cd07da2ac2746488edfc601b7c87536; no voters: 08:29:08.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.181098 27691 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "21918702d7c347c585131471624ac811" candidate_uuid: "155671c7bf4c46dd981a3ae121047f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800c7a6c7a1343dc98e290b54f801242" 08:29:08.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.181149 27691 raft_consensus.cc:2901] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242 [term 0 FOLLOWER]: Advancing to term 1 08:29:08.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.182140 27691 raft_consensus.cc:2355] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155671c7bf4c46dd981a3ae121047f5d in term 1. 08:29:08.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.182684 27775 raft_consensus.cc:2649] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 1 FOLLOWER]: Leader election won for term 1 08:29:08.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.183058 27775 raft_consensus.cc:660] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [term 1 LEADER]: Becoming Leader. State: Replica: 155671c7bf4c46dd981a3ae121047f5d, State: Running, Role: LEADER 08:29:08.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.183398 27775 consensus_queue.cc:205] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } } 08:29:08.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.184602 27738 tablet.cc:1764] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:08.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.188921 27166 catalog_manager.cc:4143] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d reported cstate change: term changed from 0 to 1, leader changed from to 155671c7bf4c46dd981a3ae121047f5d (127.26.126.1). New cstate: current_term: 1 leader_uuid: "155671c7bf4c46dd981a3ae121047f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155671c7bf4c46dd981a3ae121047f5d" member_type: VOTER last_known_addr { host: "127.26.126.1" port: 42793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 } health_report { overall_health: UNKNOWN } } } 08:29:08.214 [DEBUG - New I/O worker #3] (AsyncKuduClient.java:2346) Learned about tablet 21918702d7c347c585131471624ac811 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:08.217 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2e19621a, flushNotification=Deferred@58364402(state=PENDING, result=null, callback=, errback=)} 08:29:08.215 [DEBUG - New I/O worker #3] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299991, tablet=21918702d7c347c585131471624ac811@[155671c7bf4c46dd981a3ae121047f5d(127.26.126.1:42793)[L],5cd07da2ac2746488edfc601b7c87536(127.26.126.2:42659),800c7a6c7a1343dc98e290b54f801242(127.26.126.3:38727)]}] 08:29:08.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.237738 27471 tablet.cc:1764] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:08.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.310088 27609 tablet.cc:1764] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:08.334 [DEBUG - New I/O worker #4] (Negotiator.java:764) Authenticated connection [id: 0x6c992925, /127.0.0.1:59134 => /127.26.126.1:42793] using TOKEN/null 08:29:08.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.341534 27556 raft_consensus.cc:1177] T 21918702d7c347c585131471624ac811 P 5cd07da2ac2746488edfc601b7c87536 [term 1 FOLLOWER]: Refusing update from remote peer 155671c7bf4c46dd981a3ae121047f5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:08.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.341552 27691 raft_consensus.cc:1177] T 21918702d7c347c585131471624ac811 P 800c7a6c7a1343dc98e290b54f801242 [term 1 FOLLOWER]: Refusing update from remote peer 155671c7bf4c46dd981a3ae121047f5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:08.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.342272 27775 consensus_queue.cc:981] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "800c7a6c7a1343dc98e290b54f801242" member_type: VOTER last_known_addr { host: "127.26.126.3" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:08.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.342413 27778 consensus_queue.cc:981] T 21918702d7c347c585131471624ac811 P 155671c7bf4c46dd981a3ae121047f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cd07da2ac2746488edfc601b7c87536" member_type: VOTER last_known_addr { host: "127.26.126.2" port: 42659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:08.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.354176 27783 mvcc.cc:203] Tried to move safe_time back from 6445957727598694400 to 6445957726961209344. Current Snapshot: MvccSnapshot[committed={T|T < 6445957727598694400}] 08:29:08.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.354583 27782 mvcc.cc:203] Tried to move safe_time back from 6445957727598694400 to 6445957726961209344. Current Snapshot: MvccSnapshot[committed={T|T < 6445957727598694400}] 08:29:08.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.357441 27784 mvcc.cc:203] Tried to move safe_time back from 6445957727598694400 to 6445957726961209344. Current Snapshot: MvccSnapshot[committed={T|T < 6445957727598694400}] 08:29:08.391 [DEBUG - New I/O worker #4] (AsyncKuduScanner.java:1141) AsyncKuduScanner$Response(scannerId = "", data = RowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestAsyncKuduSession, tablet=21918702d7c347c585131471624ac811, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=, endPrimaryKey=) 08:29:08.397 [DEBUG - New I/O worker #2] (Connection.java:691) [peer master-127.26.126.60:35489(127.26.126.60:35489)] cleaning up while in state READY due to: connection disconnected 08:29:08.399 [DEBUG - New I/O worker #3] (Connection.java:691) [peer master-127.26.126.62:38829(127.26.126.62:38829)] cleaning up while in state READY due to: connection disconnected 08:29:08.401 [DEBUG - New I/O worker #4] (Connection.java:691) [peer 155671c7bf4c46dd981a3ae121047f5d(127.26.126.1:42793)] cleaning up while in state READY due to: connection disconnected 08:29:08.401 [DEBUG - New I/O worker #1] (Connection.java:691) [peer master-127.26.126.61:40495(127.26.126.61:40495)] cleaning up while in state READY due to: connection disconnected 08:29:08.402 [DEBUG - main] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:08.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.405170 27128 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 27329 08:29:08.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.410750 27128 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 27475 08:29:08.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.415933 27128 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 27613 08:29:08.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.419492 27128 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 27137 08:29:08.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.423619 27128 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 27200 08:29:08.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.427672 27128 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 27265 08:29:08.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:08Z chronyd exiting 08:29:08.453 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720148453 08:29:08.455 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:08.455 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:08.456 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:08.456 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:08.456 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:08.458 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968" hms_mode: NONE mini_kdc_options { } } 08:29:08.526 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:08.527 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:08.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:08.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:08Z Disabled control of system clock 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.544687 27793 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/wal 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/data 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.126:45629 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.126 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/logs 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/data/info.pb 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:08.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:08.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.599139 27802 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:08.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.599364 27802 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:08.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.600486 27802 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:08.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.600520 27802 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:08.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.600533 27802 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:08.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.600546 27802 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:08.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.602519 27802 master_main.cc:98] Master server non-default flags: 08:29:08.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:08.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:08.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:08.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/data 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/wal 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.126:45629 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/data/info.pb 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.126 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.27802 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/logs 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:08.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:08.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:08.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:08.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:08.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:08.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.610354 27802 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:08.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.611527 27802 hybrid_clock.cc:181] HybridClock initialized: now 1573720148611493 us; error 36 us; skew 500 ppm 08:29:08.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.612102 27802 fs_manager.cc:261] Metadata directory not provided 08:29:08.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.612154 27802 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:08.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.612442 27802 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:08.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.612473 27802 server_base.cc:453] Attempting to create new FS layout instead 08:29:08.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.614396 27802 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/data/instance: 08:29:08.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "dafa663da5784577ad39fb6b31968b29" 08:29:08.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.614703 27802 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/wal/instance: 08:29:08.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "dafa663da5784577ad39fb6b31968b29" 08:29:08.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.619993 27802 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s 08:29:08.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.620962 27802 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:08.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.621488 27802 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.624940 27802 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.625046 27802 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/wal 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "dafa663da5784577ad39fb6b31968b29" 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.625149 27802 fs_report.cc:352] FS layout report 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/wal 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/wal 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/data/data 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:08.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.668267 27802 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:08.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.673485 27802 rpc_server.cc:211] RPC server started. Bound to: 127.27.36.126:45629 08:29:08.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.674258 27802 webserver.cc:382] Webserver started at http://127.27.36.126:39003/ using document root and password file 08:29:08.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.674762 27802 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-0/data/info.pb 08:29:08.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.677289 27863 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:08.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.680687 27863 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } has no permanent_uuid. Determining permanent_uuid... 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.680732 27793 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 27802 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.681264 27793 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/wal 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/data 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.125:42865 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.125 08:29:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/logs 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/data/info.pb 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:08.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:08.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:08.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:08.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:08.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.692948 27863 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } has no permanent_uuid. Determining permanent_uuid... 08:29:08.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.693804 27863 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.36.125:42865: Network error: Client connection negotiation failed: client connection to 127.27.36.125:42865: connect: Connection refused (error 111) 08:29:08.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.713120 27863 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } attempt: 1 08:29:08.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.714290 27863 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.36.125:42865: Network error: Client connection negotiation failed: client connection to 127.27.36.125:42865: connect: Connection refused (error 111) 08:29:08.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:08.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.739468 27864 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:08.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.739675 27864 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:08.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.740836 27864 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:08.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.740869 27864 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:08.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.740881 27864 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:08.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.740895 27864 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:08.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.742838 27864 master_main.cc:98] Master server non-default flags: 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/data 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/wal 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.125:42865 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/data/info.pb 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.125 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.27864 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/logs 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:08.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:08.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.749825 27864 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.751044 27864 hybrid_clock.cc:181] HybridClock initialized: now 1573720148751003 us; error 49 us; skew 500 ppm 08:29:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.751529 27864 fs_manager.cc:261] Metadata directory not provided 08:29:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.751572 27864 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.751828 27864 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.751857 27864 server_base.cc:453] Attempting to create new FS layout instead 08:29:08.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.753684 27864 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/data/instance: 08:29:08.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "08a11476ee5d48e5ab2a9f7972da54df" 08:29:08.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.753983 27864 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/wal/instance: 08:29:08.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "08a11476ee5d48e5ab2a9f7972da54df" 08:29:08.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.759138 27864 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s 08:29:08.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.759778 27864 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:08.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.760166 27864 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:08.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.762461 27863 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } attempt: 2 08:29:08.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.763254 27863 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.36.125:42865: Network error: Client connection negotiation failed: client connection to 127.27.36.125:42865: connect: Connection refused (error 111) 08:29:08.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.763622 27864 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:08.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.763753 27864 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/wal 08:29:08.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "08a11476ee5d48e5ab2a9f7972da54df" 08:29:08.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.763870 27864 fs_report.cc:352] FS layout report 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/wal 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/wal 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/data/data 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:08.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:08.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:08.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:08.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:08.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:08.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:08.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.821310 27864 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:08.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.826761 27864 rpc_server.cc:211] RPC server started. Bound to: 127.27.36.125:42865 08:29:08.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.827538 27864 webserver.cc:382] Webserver started at http://127.27.36.125:45771/ using document root and password file 08:29:08.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.828029 27864 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-1/data/info.pb 08:29:08.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.831121 27928 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:08.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.835178 27928 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } has no permanent_uuid. Determining permanent_uuid... 08:29:08.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.838062 27793 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 27864 08:29:08.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.838461 27793 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:08.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:08.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/wal 08:29:08.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/data 08:29:08.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:08.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.124:36915 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.124 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/logs 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/data/info.pb 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:08.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.844233 27928 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } has no permanent_uuid. Determining permanent_uuid... 08:29:08.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.850944 27928 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } has no permanent_uuid. Determining permanent_uuid... 08:29:08.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.851850 27928 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.36.124:36915: Network error: Client connection negotiation failed: client connection to 127.27.36.124:36915: connect: Connection refused (error 111) 08:29:08.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.871170 27928 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } attempt: 1 08:29:08.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.872200 27928 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.36.124:36915: Network error: Client connection negotiation failed: client connection to 127.27.36.124:36915: connect: Connection refused (error 111) 08:29:08.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.874449 27863 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } attempt: 3 08:29:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.878388 27863 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } has no permanent_uuid. Determining permanent_uuid... 08:29:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.879227 27863 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.36.124:36915: Network error: Client connection negotiation failed: client connection to 127.27.36.124:36915: connect: Connection refused (error 111) 08:29:08.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:08.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.903331 27930 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:08.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.903573 27930 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:08.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.904755 27930 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:08.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.904817 27930 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:08.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.904834 27930 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:08.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.904847 27930 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:08.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.906894 27930 master_main.cc:98] Master server non-default flags: 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/data 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/wal 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.124:36915 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/data/info.pb 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.124 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.27930 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/logs 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:08.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.915503 27930 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:08.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.916704 27930 hybrid_clock.cc:181] HybridClock initialized: now 1573720148916674 us; error 32 us; skew 500 ppm 08:29:08.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.917335 27930 fs_manager.cc:261] Metadata directory not provided 08:29:08.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.917389 27930 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:08.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.917728 27930 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:08.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.917762 27930 server_base.cc:453] Attempting to create new FS layout instead 08:29:08.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.919888 27930 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/data/instance: 08:29:08.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "4dc26264dd6144dd8bf99a105d7a580f" 08:29:08.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.920208 27930 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/wal/instance: 08:29:08.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "4dc26264dd6144dd8bf99a105d7a580f" 08:29:08.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.920390 27928 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } attempt: 2 08:29:08.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.921370 27928 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.36.124:36915: Network error: Client connection negotiation failed: client connection to 127.27.36.124:36915: connect: Connection refused (error 111) 08:29:08.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.926055 27930 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s 08:29:08.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.926795 27930 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:08.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.927316 27930 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:08.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.930626 27930 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:08.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.930716 27930 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/wal 08:29:08.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "4dc26264dd6144dd8bf99a105d7a580f" 08:29:08.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:08 on dist-test-slave-dist-test-slave-05kx" 08:29:08.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.930811 27930 fs_report.cc:352] FS layout report 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/wal 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/wal 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/data/data 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:08.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.943400 27863 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } attempt: 1 08:29:08.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:08.944456 27863 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.36.124:36915: Network error: Client connection negotiation failed: client connection to 127.27.36.124:36915: connect: Connection refused (error 111) 08:29:08.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.975765 27930 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:08.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.980352 27930 rpc_server.cc:211] RPC server started. Bound to: 127.27.36.124:36915 08:29:08.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.981112 27930 webserver.cc:382] Webserver started at http://127.27.36.124:46115/ using document root and password file 08:29:08.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.981685 27930 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/master-2/data/info.pb 08:29:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.984345 27793 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 27930 08:29:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.984696 27992 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.984901 27793 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/wal 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/data 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.65:0 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.36.65 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.65 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/logs 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/data/info.pb 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:08.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:08.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:08.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.989429 27992 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } has no permanent_uuid. Determining permanent_uuid... 08:29:08.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:08.997611 27992 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } has no permanent_uuid. Determining permanent_uuid... 08:29:09.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.001629 27992 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } has no permanent_uuid. Determining permanent_uuid... 08:29:09.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.008754 27992 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f: Bootstrap starting. 08:29:09.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.010857 27992 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f: No blocks or log segments found. Creating new log. 08:29:09.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.011745 27992 log.cc:558] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f: Log is configured to *not* fsync() on all Append() calls 08:29:09.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.013443 27992 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f: No bootstrap required, opened a new log 08:29:09.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.015869 27992 raft_consensus.cc:333] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.015966 27992 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:09.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.016026 27992 raft_consensus.cc:698] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc26264dd6144dd8bf99a105d7a580f, State: Initialized, Role: FOLLOWER 08:29:09.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.016484 27992 consensus_queue.cc:228] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.016844 27992 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.016880 27992 sys_catalog.cc:343] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.017148 27997 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.017230 27997 sys_catalog.cc:343] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.017792 27992 sys_catalog.cc:428] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: configured and running, proceeding with master startup. 08:29:09.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.023275 27998 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:09.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.023327 27998 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:09.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.023648 27863 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } attempt: 2 08:29:09.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.029747 27863 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29: Bootstrap starting. 08:29:09.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.032014 27863 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29: No blocks or log segments found. Creating new log. 08:29:09.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.032568 27928 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } attempt: 3 08:29:09.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.033113 27863 log.cc:558] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29: Log is configured to *not* fsync() on all Append() calls 08:29:09.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.039074 27863 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29: No bootstrap required, opened a new log 08:29:09.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:09.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.044718 27993 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:09.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.045464 27993 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:09.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.045781 27928 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df: Bootstrap starting. 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.046758 27863 raft_consensus.cc:333] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.046841 27863 raft_consensus.cc:359] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.046885 27863 raft_consensus.cc:698] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dafa663da5784577ad39fb6b31968b29, State: Initialized, Role: FOLLOWER 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.046912 27993 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.046990 27993 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.36.65 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.047466 27863 consensus_queue.cc:228] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.047875 27863 sys_catalog.cc:340] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.047904 27863 sys_catalog.cc:343] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.048337 27928 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df: No blocks or log segments found. Creating new log. 08:29:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.048960 27863 sys_catalog.cc:428] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: configured and running, proceeding with master startup. 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.049258 28001 sys_catalog.cc:340] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.049284 28001 sys_catalog.cc:343] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.049561 27993 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/data 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/wal 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.65:0 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/data/info.pb 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.65 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.27993 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.36.65 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/logs 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:09.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.052075 27928 log.cc:558] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df: Log is configured to *not* fsync() on all Append() calls 08:29:09.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.055699 28002 catalog_manager.cc:1159] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:09.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.055761 28002 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:09.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.057037 27928 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df: No bootstrap required, opened a new log 08:29:09.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.059742 27928 raft_consensus.cc:333] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.059828 27928 raft_consensus.cc:359] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:09.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.059875 27928 raft_consensus.cc:698] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a11476ee5d48e5ab2a9f7972da54df, State: Initialized, Role: FOLLOWER 08:29:09.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.060449 27928 consensus_queue.cc:228] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.060853 27928 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.060899 27928 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.061849 27928 sys_catalog.cc:428] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: configured and running, proceeding with master startup. 08:29:09.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.065109 28008 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.065171 28008 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.068104 28009 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:09.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.068150 28009 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:09.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.072654 27883 tablet.cc:1764] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:09.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.080530 27993 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.096122 27993 hybrid_clock.cc:181] HybridClock initialized: now 1573720149096051 us; error 66 us; skew 500 ppm 08:29:09.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.097007 27993 fs_manager.cc:261] Metadata directory not provided 08:29:09.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.097085 27993 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.097416 27993 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.097453 27993 server_base.cc:453] Attempting to create new FS layout instead 08:29:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.099611 27993 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/data/instance: 08:29:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "734e1fee92d6486bb1a49ce326e2f6eb" 08:29:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.099840 27993 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/wal/instance: 08:29:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "734e1fee92d6486bb1a49ce326e2f6eb" 08:29:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.110715 27993 fs_manager.cc:508] Time spent creating directory manager: real 0.011s user 0.002s sys 0.004s 08:29:09.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.111719 27993 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:09.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.112274 27993 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:09.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.115362 27993 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:09.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.115504 27993 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/wal 08:29:09.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "734e1fee92d6486bb1a49ce326e2f6eb" 08:29:09.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.115622 27993 fs_report.cc:352] FS layout report 08:29:09.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:09.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/wal 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/wal 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/data/data 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:09.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.145310 27993 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:09.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.146661 27993 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:09.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.146692 27993 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:09.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.152732 27993 rpc_server.cc:211] RPC server started. Bound to: 127.27.36.65:39385 08:29:09.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.154986 27993 webserver.cc:382] Webserver started at http://127.27.36.65:33035/ using document root and password file 08:29:09.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.155629 27993 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-0/data/info.pb 08:29:09.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.162173 27793 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 27993 08:29:09.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.162796 27793 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:09.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/wal 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/data 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.66:0 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.36.66 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.66 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:09.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/logs 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/data/info.pb 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:09.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.169800 27819 tablet.cc:1764] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:09.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.204035 28129 heartbeater.cc:322] Connected to a master server at 127.27.36.124:36915 08:29:09.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.204231 28129 heartbeater.cc:406] Registering TS with master... 08:29:09.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.204818 28129 heartbeater.cc:455] Master 127.27.36.124:36915 requested a full tablet report, sending... 08:29:09.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.206601 27959 ts_manager.cc:191] Registered new tserver with Master: 734e1fee92d6486bb1a49ce326e2f6eb (127.27.36.65:39385) 08:29:09.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.206728 28130 heartbeater.cc:322] Connected to a master server at 127.27.36.125:42865 08:29:09.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.206804 28130 heartbeater.cc:406] Registering TS with master... 08:29:09.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.207003 28130 heartbeater.cc:455] Master 127.27.36.125:42865 requested a full tablet report, sending... 08:29:09.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.208134 27894 ts_manager.cc:191] Registered new tserver with Master: 734e1fee92d6486bb1a49ce326e2f6eb (127.27.36.65:39385) 08:29:09.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.210498 28131 heartbeater.cc:322] Connected to a master server at 127.27.36.126:45629 08:29:09.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.210566 28131 heartbeater.cc:406] Registering TS with master... 08:29:09.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.210717 28131 heartbeater.cc:455] Master 127.27.36.126:45629 requested a full tablet report, sending... 08:29:09.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.211750 27830 ts_manager.cc:191] Registered new tserver with Master: 734e1fee92d6486bb1a49ce326e2f6eb (127.27.36.65:39385) 08:29:09.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.227103 27948 tablet.cc:1764] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:09.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.282706 28008 raft_consensus.cc:465] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:09.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.282953 28008 raft_consensus.cc:487] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.284126 28008 leader_election.cc:296] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dafa663da5784577ad39fb6b31968b29 (127.27.36.126:45629), 4dc26264dd6144dd8bf99a105d7a580f (127.27.36.124:36915) 08:29:09.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.285111 27969 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "08a11476ee5d48e5ab2a9f7972da54df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dc26264dd6144dd8bf99a105d7a580f" is_pre_election: true 08:29:09.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.285351 27969 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a11476ee5d48e5ab2a9f7972da54df in term 0. 08:29:09.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.285820 27840 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "08a11476ee5d48e5ab2a9f7972da54df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dafa663da5784577ad39fb6b31968b29" is_pre_election: true 08:29:09.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.285980 27874 leader_election.cc:310] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a11476ee5d48e5ab2a9f7972da54df, 4dc26264dd6144dd8bf99a105d7a580f; no voters: 08:29:09.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.286025 27840 raft_consensus.cc:2355] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a11476ee5d48e5ab2a9f7972da54df in term 0. 08:29:09.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.286463 28008 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:09.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.286535 28008 raft_consensus.cc:465] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:09.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.286571 28008 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 0 FOLLOWER]: Advancing to term 1 08:29:09.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.287719 28008 raft_consensus.cc:487] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.288095 28008 leader_election.cc:296] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [CANDIDATE]: Term 1 election: Requested vote from peers dafa663da5784577ad39fb6b31968b29 (127.27.36.126:45629), 4dc26264dd6144dd8bf99a105d7a580f (127.27.36.124:36915) 08:29:09.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.288512 27840 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "08a11476ee5d48e5ab2a9f7972da54df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dafa663da5784577ad39fb6b31968b29" 08:29:09.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.288636 27969 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "08a11476ee5d48e5ab2a9f7972da54df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dc26264dd6144dd8bf99a105d7a580f" 08:29:09.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.288617 27840 raft_consensus.cc:2901] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [term 0 FOLLOWER]: Advancing to term 1 08:29:09.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.288723 27969 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [term 0 FOLLOWER]: Advancing to term 1 08:29:09.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.289839 27840 raft_consensus.cc:2355] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a11476ee5d48e5ab2a9f7972da54df in term 1. 08:29:09.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.289993 27969 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a11476ee5d48e5ab2a9f7972da54df in term 1. 08:29:09.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.290313 27877 leader_election.cc:310] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a11476ee5d48e5ab2a9f7972da54df, dafa663da5784577ad39fb6b31968b29; no voters: 08:29:09.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.290511 28008 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 1 FOLLOWER]: Leader election won for term 1 08:29:09.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.290761 28008 raft_consensus.cc:660] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [term 1 LEADER]: Becoming Leader. State: Replica: 08a11476ee5d48e5ab2a9f7972da54df, State: Running, Role: LEADER 08:29:09.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.291222 28008 consensus_queue.cc:205] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } 08:29:09.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.293651 28137 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08a11476ee5d48e5ab2a9f7972da54df. Latest consensus state: current_term: 1 leader_uuid: "08a11476ee5d48e5ab2a9f7972da54df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.293692 28137 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: This master's current role is: LEADER 08:29:09.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.301069 28139 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:09.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.302242 28139 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:09.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:09.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.308507 28133 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:09.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.308718 28133 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:09.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.317863 28133 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:09.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.317958 28133 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.36.66 08:29:09.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.319680 28133 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:09.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:09.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/data 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/wal 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.66:0 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/data/info.pb 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.66 08:29:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.28133 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.36.66 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/logs 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:09.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:09.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:09.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:09.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:09.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:09.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.330763 27969 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [term 1 FOLLOWER]: Refusing update from remote peer 08a11476ee5d48e5ab2a9f7972da54df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.331565 27840 raft_consensus.cc:1177] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [term 1 FOLLOWER]: Refusing update from remote peer 08a11476ee5d48e5ab2a9f7972da54df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.332350 28137 consensus_queue.cc:981] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [LEADER]: Connected to new peer: Peer: permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.332482 28008 consensus_queue.cc:981] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:09.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.336758 27997 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08a11476ee5d48e5ab2a9f7972da54df. Latest consensus state: current_term: 1 leader_uuid: "08a11476ee5d48e5ab2a9f7972da54df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.336836 27997 sys_catalog.cc:343] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.336971 28001 sys_catalog.cc:340] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08a11476ee5d48e5ab2a9f7972da54df. Latest consensus state: current_term: 1 leader_uuid: "08a11476ee5d48e5ab2a9f7972da54df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.337014 28001 sys_catalog.cc:343] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.339524 28133 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:09.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.339814 28008 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "08a11476ee5d48e5ab2a9f7972da54df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.339843 28008 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: This master's current role is: LEADER 08:29:09.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.340214 28008 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "08a11476ee5d48e5ab2a9f7972da54df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.340245 28008 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df [sys.catalog]: This master's current role is: LEADER 08:29:09.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.341351 27997 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "08a11476ee5d48e5ab2a9f7972da54df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.341378 27997 sys_catalog.cc:343] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.341763 28139 catalog_manager.cc:985] Generated new certificate authority record 08:29:09.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.342177 28001 sys_catalog.cc:340] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "08a11476ee5d48e5ab2a9f7972da54df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dafa663da5784577ad39fb6b31968b29" member_type: VOTER last_known_addr { host: "127.27.36.126" port: 45629 } } peers { permanent_uuid: "08a11476ee5d48e5ab2a9f7972da54df" member_type: VOTER last_known_addr { host: "127.27.36.125" port: 42865 } } peers { permanent_uuid: "4dc26264dd6144dd8bf99a105d7a580f" member_type: VOTER last_known_addr { host: "127.27.36.124" port: 36915 } } } 08:29:09.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.342203 28001 sys_catalog.cc:343] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29 [sys.catalog]: This master's current role is: FOLLOWER 08:29:09.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.342698 28145 mvcc.cc:203] Tried to move safe_time back from 6445957731649576960 to 6445957731499290624. Current Snapshot: MvccSnapshot[committed={T|T < 6445957731649576960}] 08:29:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.343036 28143 mvcc.cc:203] Tried to move safe_time back from 6445957731649576960 to 6445957731499290624. Current Snapshot: MvccSnapshot[committed={T|T < 6445957731649576960 or (T in {6445957731649576960})}] 08:29:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.343243 28139 catalog_manager.cc:1110] Loading token signing keys... 08:29:09.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.345259 28144 mvcc.cc:203] Tried to move safe_time back from 6445957731649576960 to 6445957731499290624. Current Snapshot: MvccSnapshot[committed={T|T < 6445957731649576960}] 08:29:09.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.350121 28139 catalog_manager.cc:4455] T 00000000000000000000000000000000 P 08a11476ee5d48e5ab2a9f7972da54df: Generated new TSK 0 08:29:09.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.350713 28139 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:09.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.357000 28133 hybrid_clock.cc:181] HybridClock initialized: now 1573720149356935 us; error 42 us; skew 500 ppm 08:29:09.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.357590 28133 fs_manager.cc:261] Metadata directory not provided 08:29:09.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.357638 28133 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:09.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.357872 28133 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:09.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.357900 28133 server_base.cc:453] Attempting to create new FS layout instead 08:29:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.359679 28133 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/data/instance: 08:29:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "437e95f9a7da4c18844079e3be856e6f" 08:29:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.359927 28133 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/wal/instance: 08:29:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "437e95f9a7da4c18844079e3be856e6f" 08:29:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.364914 28133 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s 08:29:09.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.365882 28133 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:09.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.366462 28133 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:09.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.369633 28133 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:09.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.369803 28133 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/wal 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "437e95f9a7da4c18844079e3be856e6f" 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.369952 28133 fs_report.cc:352] FS layout report 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/wal 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/wal 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/data/data 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:09.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:09.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:09.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:09.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:09.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:09.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:09.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.388365 28133 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:09.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.390028 28133 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:09.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.390065 28133 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:09.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.399493 28133 rpc_server.cc:211] RPC server started. Bound to: 127.27.36.66:38029 08:29:09.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.400456 28133 webserver.cc:382] Webserver started at http://127.27.36.66:37969/ using document root and password file 08:29:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.401084 28133 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-1/data/info.pb 08:29:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.402463 27793 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 28133 08:29:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.403117 27793 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/wal 08:29:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/data 08:29:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.67:0 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.36.67 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.67 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/logs 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/data/info.pb 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:09.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:09.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:09.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:09.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:09.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.416340 28272 heartbeater.cc:322] Connected to a master server at 127.27.36.126:45629 08:29:09.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.416381 28271 heartbeater.cc:322] Connected to a master server at 127.27.36.125:42865 08:29:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.416471 28270 heartbeater.cc:322] Connected to a master server at 127.27.36.124:36915 08:29:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.417166 28271 heartbeater.cc:406] Registering TS with master... 08:29:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.417201 28270 heartbeater.cc:406] Registering TS with master... 08:29:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.416932 28272 heartbeater.cc:406] Registering TS with master... 08:29:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.417615 28271 heartbeater.cc:455] Master 127.27.36.125:42865 requested a full tablet report, sending... 08:29:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.417634 28272 heartbeater.cc:455] Master 127.27.36.126:45629 requested a full tablet report, sending... 08:29:09.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.418063 28270 heartbeater.cc:455] Master 127.27.36.124:36915 requested a full tablet report, sending... 08:29:09.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.418925 27959 ts_manager.cc:191] Registered new tserver with Master: 437e95f9a7da4c18844079e3be856e6f (127.27.36.66:38029) 08:29:09.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.418967 27830 ts_manager.cc:191] Registered new tserver with Master: 437e95f9a7da4c18844079e3be856e6f (127.27.36.66:38029) 08:29:09.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.418978 27894 ts_manager.cc:191] Registered new tserver with Master: 437e95f9a7da4c18844079e3be856e6f (127.27.36.66:38029) 08:29:09.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.420536 27894 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.27.36.66:35133 08:29:09.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:09.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.456679 28277 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:09.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.456960 28277 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:09.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.457962 28277 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:09.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.458026 28277 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.36.67 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.459550 28277 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.36.84:46671 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/data 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/wal 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.36.67:0 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/data/info.pb 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.36.67 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.36.126:45629,127.27.36.125:42865,127.27.36.124:36915 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.28277 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.36.67 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/logs 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:09.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:09.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.466461 28277 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:09.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.467624 28277 hybrid_clock.cc:181] HybridClock initialized: now 1573720149467575 us; error 51 us; skew 500 ppm 08:29:09.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.468045 28277 fs_manager.cc:261] Metadata directory not provided 08:29:09.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.468088 28277 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:09.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.468335 28277 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:09.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.468365 28277 server_base.cc:453] Attempting to create new FS layout instead 08:29:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.470144 28277 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/data/instance: 08:29:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "1a0c186aee68440f9d7e333ebbaf35aa" 08:29:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.470441 28277 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/wal/instance: 08:29:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "1a0c186aee68440f9d7e333ebbaf35aa" 08:29:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.475364 28277 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s 08:29:09.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.476250 28277 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:09.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.476810 28277 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:09.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.479789 28277 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:09.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.479899 28277 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/wal 08:29:09.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "1a0c186aee68440f9d7e333ebbaf35aa" 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:09 on dist-test-slave-dist-test-slave-05kx" 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.479979 28277 fs_report.cc:352] FS layout report 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/wal 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/wal 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/data/data 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.527604 28277 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:09.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.528875 28277 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:09.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.528905 28277 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:09.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.537043 28277 rpc_server.cc:211] RPC server started. Bound to: 127.27.36.67:39249 08:29:09.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.537966 28277 webserver.cc:382] Webserver started at http://127.27.36.67:34247/ using document root and password file 08:29:09.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.538532 28277 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3264170046317529968/ts-2/data/info.pb 08:29:09.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.539497 27793 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 28277 08:29:09.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.548879 28399 heartbeater.cc:322] Connected to a master server at 127.27.36.124:36915 08:29:09.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.549315 28399 heartbeater.cc:406] Registering TS with master... 08:29:09.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.549371 28400 heartbeater.cc:322] Connected to a master server at 127.27.36.125:42865 08:29:09.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.549572 28400 heartbeater.cc:406] Registering TS with master... 08:29:09.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.549120 28401 heartbeater.cc:322] Connected to a master server at 127.27.36.126:45629 08:29:09.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.549770 28401 heartbeater.cc:406] Registering TS with master... 08:29:09.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.549975 28401 heartbeater.cc:455] Master 127.27.36.126:45629 requested a full tablet report, sending... 08:29:09.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.550094 28399 heartbeater.cc:455] Master 127.27.36.124:36915 requested a full tablet report, sending... 08:29:09.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.551147 27830 ts_manager.cc:191] Registered new tserver with Master: 1a0c186aee68440f9d7e333ebbaf35aa (127.27.36.67:39249) 08:29:09.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.551152 27959 ts_manager.cc:191] Registered new tserver with Master: 1a0c186aee68440f9d7e333ebbaf35aa (127.27.36.67:39249) 08:29:09.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.549979 28400 heartbeater.cc:455] Master 127.27.36.125:42865 requested a full tablet report, sending... 08:29:09.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.552691 27894 ts_manager.cc:191] Registered new tserver with Master: 1a0c186aee68440f9d7e333ebbaf35aa (127.27.36.67:39249) 08:29:09.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.553501 27894 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.27.36.67:50103 08:29:09.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.561245 27793 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:09.561 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:09.561 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:09.562 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.27.36.126" port: 45629 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.27.36.125" port: 42865 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.27.36.124" port: 36915 } } } 08:29:09.563 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:09.564 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.27.36.65" port: 39385 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.27.36.66" port: 38029 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.27.36.67" port: 39249 } } } 08:29:09.564 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:09.570 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:09.583 [DEBUG - New I/O worker #12] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.27.36.126 08:29:09.583 [DEBUG - New I/O worker #10] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.27.36.125 08:29:09.583 [DEBUG - New I/O worker #11] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.27.36.124 08:29:09.595 [DEBUG - New I/O worker #10] (Negotiator.java:764) Authenticated connection [id: 0x9981844b, /127.0.0.1:55956 => /127.27.36.125:42865] using SASL/PLAIN 08:29:09.601 [DEBUG - New I/O worker #11] (Negotiator.java:764) Authenticated connection [id: 0xfabcd1b0, /127.0.0.1:36272 => /127.27.36.124:36915] using SASL/PLAIN 08:29:09.603 [DEBUG - New I/O worker #12] (Negotiator.java:764) Authenticated connection [id: 0x79f4ee18, /127.0.0.1:52768 => /127.27.36.126:45629] using SASL/PLAIN 08:29:09.605 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:09.605 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=34), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.36.125:42865, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.36.124:36915, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.36.126:45629, [27ms] Sub RPC ConnectToMaster: received response from server master-127.27.36.125:42865: OK, deferred=null) after lookup 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.612056 27894 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55956: 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:09.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.613405 27894 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:09.625 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:777) Opened table b463f0394a94425f8dc9f495478f56ca 08:29:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.633363 28207 tablet_service.cc:1023] Processing CreateTablet for tablet 0b54c5066771476593d702b3975527e3 (table=org.apache.kudu.client.TestAsyncKuduSession [id=b463f0394a94425f8dc9f495478f56ca]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.633363 28066 tablet_service.cc:1023] Processing CreateTablet for tablet 0b54c5066771476593d702b3975527e3 (table=org.apache.kudu.client.TestAsyncKuduSession [id=b463f0394a94425f8dc9f495478f56ca]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.633910 28207 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 0b54c5066771476593d702b3975527e3. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.633910 28066 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 0b54c5066771476593d702b3975527e3. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.634312 28333 tablet_service.cc:1023] Processing CreateTablet for tablet 0b54c5066771476593d702b3975527e3 (table=org.apache.kudu.client.TestAsyncKuduSession [id=b463f0394a94425f8dc9f495478f56ca]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.634745 28333 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 0b54c5066771476593d702b3975527e3. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:09.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.640333 28426 tablet_bootstrap.cc:439] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f: Bootstrap starting. 08:29:09.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.641151 28427 tablet_bootstrap.cc:439] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa: Bootstrap starting. 08:29:09.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.641454 28425 tablet_bootstrap.cc:439] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb: Bootstrap starting. 08:29:09.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.642472 28426 tablet_bootstrap.cc:590] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f: No blocks or log segments found. Creating new log. 08:29:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.643086 28425 tablet_bootstrap.cc:590] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb: No blocks or log segments found. Creating new log. 08:29:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.643478 28426 log.cc:558] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f: Log is configured to *not* fsync() on all Append() calls 08:29:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.643790 28425 log.cc:558] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb: Log is configured to *not* fsync() on all Append() calls 08:29:09.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.645224 28425 tablet_bootstrap.cc:439] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb: No bootstrap required, opened a new log 08:29:09.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.645435 28425 ts_tablet_manager.cc:1096] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s 08:29:09.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.645685 28426 tablet_bootstrap.cc:439] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f: No bootstrap required, opened a new log 08:29:09.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.645862 28426 ts_tablet_manager.cc:1096] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s 08:29:09.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.645923 28427 tablet_bootstrap.cc:590] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa: No blocks or log segments found. Creating new log. 08:29:09.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.646615 28427 log.cc:558] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa: Log is configured to *not* fsync() on all Append() calls 08:29:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.647920 28427 tablet_bootstrap.cc:439] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa: No bootstrap required, opened a new log 08:29:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.648097 28427 ts_tablet_manager.cc:1096] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s 08:29:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.648291 28425 raft_consensus.cc:333] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.648392 28425 raft_consensus.cc:359] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.648433 28425 raft_consensus.cc:698] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 734e1fee92d6486bb1a49ce326e2f6eb, State: Initialized, Role: FOLLOWER 08:29:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.648463 28426 raft_consensus.cc:333] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.648542 28426 raft_consensus.cc:359] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.648582 28426 raft_consensus.cc:698] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437e95f9a7da4c18844079e3be856e6f, State: Initialized, Role: FOLLOWER 08:29:09.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.648988 28425 consensus_queue.cc:228] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.649094 28426 consensus_queue.cc:228] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.649585 28271 heartbeater.cc:447] Master 127.27.36.125:42865 was elected leader, sending a full tablet report... 08:29:09.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.650779 28427 raft_consensus.cc:333] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.650843 28427 raft_consensus.cc:359] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:09.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.650871 28427 raft_consensus.cc:698] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0c186aee68440f9d7e333ebbaf35aa, State: Initialized, Role: FOLLOWER 08:29:09.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.651248 28427 consensus_queue.cc:228] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.652287 28400 heartbeater.cc:447] Master 127.27.36.125:42865 was elected leader, sending a full tablet report... 08:29:09.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.652905 28426 ts_tablet_manager.cc:1124] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s 08:29:09.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.654649 28427 ts_tablet_manager.cc:1124] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s 08:29:09.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.655390 28425 ts_tablet_manager.cc:1124] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb: Time spent starting tablet: real 0.010s user 0.002s sys 0.002s 08:29:09.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.656502 27894 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.27.36.65:52509 08:29:09.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.658252 28130 heartbeater.cc:447] Master 127.27.36.125:42865 was elected leader, sending a full tablet report... 08:29:09.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.690358 28132 tablet.cc:1764] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:09.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.790030 28402 tablet.cc:1764] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:09.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:09.902684 28273 tablet.cc:1764] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:09.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.907052 28431 raft_consensus.cc:465] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:09.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.907305 28431 raft_consensus.cc:487] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.908531 28431 leader_election.cc:296] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 437e95f9a7da4c18844079e3be856e6f (127.27.36.66:38029), 1a0c186aee68440f9d7e333ebbaf35aa (127.27.36.67:39249) 08:29:09.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.913228 28355 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "0b54c5066771476593d702b3975527e3" candidate_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" is_pre_election: true 08:29:09.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.913267 28227 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "0b54c5066771476593d702b3975527e3" candidate_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "437e95f9a7da4c18844079e3be856e6f" is_pre_election: true 08:29:09.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.913421 28355 raft_consensus.cc:2355] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 734e1fee92d6486bb1a49ce326e2f6eb in term 0. 08:29:09.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.913486 28227 raft_consensus.cc:2355] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 734e1fee92d6486bb1a49ce326e2f6eb in term 0. 08:29:09.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.913921 28018 leader_election.cc:310] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0c186aee68440f9d7e333ebbaf35aa, 734e1fee92d6486bb1a49ce326e2f6eb; no voters: 08:29:09.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.914227 28431 raft_consensus.cc:2649] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:09.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.914288 28431 raft_consensus.cc:465] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:09.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.914310 28431 raft_consensus.cc:2901] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 0 FOLLOWER]: Advancing to term 1 08:29:09.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.915395 28431 raft_consensus.cc:487] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.915789 28431 leader_election.cc:296] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [CANDIDATE]: Term 1 election: Requested vote from peers 437e95f9a7da4c18844079e3be856e6f (127.27.36.66:38029), 1a0c186aee68440f9d7e333ebbaf35aa (127.27.36.67:39249) 08:29:09.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.916265 28227 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "0b54c5066771476593d702b3975527e3" candidate_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "437e95f9a7da4c18844079e3be856e6f" 08:29:09.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.916335 28355 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "0b54c5066771476593d702b3975527e3" candidate_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" 08:29:09.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.916355 28227 raft_consensus.cc:2901] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f [term 0 FOLLOWER]: Advancing to term 1 08:29:09.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.916442 28355 raft_consensus.cc:2901] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa [term 0 FOLLOWER]: Advancing to term 1 08:29:09.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.917364 28227 raft_consensus.cc:2355] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 734e1fee92d6486bb1a49ce326e2f6eb in term 1. 08:29:09.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.917497 28355 raft_consensus.cc:2355] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 734e1fee92d6486bb1a49ce326e2f6eb in term 1. 08:29:09.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.917786 28018 leader_election.cc:310] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 437e95f9a7da4c18844079e3be856e6f, 734e1fee92d6486bb1a49ce326e2f6eb; no voters: 08:29:09.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.918006 28431 raft_consensus.cc:2649] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 1 FOLLOWER]: Leader election won for term 1 08:29:09.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.918226 28431 raft_consensus.cc:660] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [term 1 LEADER]: Becoming Leader. State: Replica: 734e1fee92d6486bb1a49ce326e2f6eb, State: Running, Role: LEADER 08:29:09.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.918622 28431 consensus_queue.cc:205] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } } 08:29:09.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:09.922502 27893 catalog_manager.cc:4143] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb reported cstate change: term changed from 0 to 1, leader changed from to 734e1fee92d6486bb1a49ce326e2f6eb (127.27.36.65). New cstate: current_term: 1 leader_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "734e1fee92d6486bb1a49ce326e2f6eb" member_type: VOTER last_known_addr { host: "127.27.36.65" port: 39385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 } health_report { overall_health: UNKNOWN } } } 08:29:10.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.026401 27998 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f: acquiring CA information for follower catalog manager: success 08:29:10.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.027529 27998 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 4dc26264dd6144dd8bf99a105d7a580f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:10.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.058840 28002 catalog_manager.cc:1157] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29: acquiring CA information for follower catalog manager: success 08:29:10.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.059932 28002 catalog_manager.cc:1185] T 00000000000000000000000000000000 P dafa663da5784577ad39fb6b31968b29: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:10.124 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.124 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.124 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@78fa769e, flushNotification=Deferred@375466577(state=PENDING, result=null, callback=, errback=)} 08:29:10.126 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.126 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.127 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@54e041a4, flushNotification=Deferred@746074699(state=PENDING, result=null, callback=, errback=)} 08:29:10.130 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.131 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.133 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.133 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.138 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.138 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.139 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.139 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.140 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.141 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.141 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.141 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.142 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.142 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.142 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2346) Learned about tablet 0b54c5066771476593d702b3975527e3 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:10.143 [DEBUG - New I/O worker #10] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0b54c5066771476593d702b3975527e3@[1a0c186aee68440f9d7e333ebbaf35aa(127.27.36.67:39249),437e95f9a7da4c18844079e3be856e6f(127.27.36.66:38029),734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)[L]]}] 08:29:10.149 [DEBUG - New I/O worker #13] (Negotiator.java:764) Authenticated connection [id: 0x0bc4892b, /127.0.0.1:39828 => /127.27.36.65:39385] using TOKEN/null 08:29:10.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.156852 28355 raft_consensus.cc:1177] T 0b54c5066771476593d702b3975527e3 P 1a0c186aee68440f9d7e333ebbaf35aa [term 1 FOLLOWER]: Refusing update from remote peer 734e1fee92d6486bb1a49ce326e2f6eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:10.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.156852 28227 raft_consensus.cc:1177] T 0b54c5066771476593d702b3975527e3 P 437e95f9a7da4c18844079e3be856e6f [term 1 FOLLOWER]: Refusing update from remote peer 734e1fee92d6486bb1a49ce326e2f6eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:10.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.157650 28431 consensus_queue.cc:981] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0c186aee68440f9d7e333ebbaf35aa" member_type: VOTER last_known_addr { host: "127.27.36.67" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:10.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.157793 28436 consensus_queue.cc:981] T 0b54c5066771476593d702b3975527e3 P 734e1fee92d6486bb1a49ce326e2f6eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "437e95f9a7da4c18844079e3be856e6f" member_type: VOTER last_known_addr { host: "127.27.36.66" port: 38029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.167850 28438 mvcc.cc:203] Tried to move safe_time back from 6445957735037906944 to 6445957734068674560. Current Snapshot: MvccSnapshot[committed={T|T < 6445957735034163200}] 08:29:10.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.169610 28442 mvcc.cc:203] Tried to move safe_time back from 6445957735037906944 to 6445957734068674560. Current Snapshot: MvccSnapshot[committed={T|T < 6445957735034163200}] 08:29:10.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.170795 28441 mvcc.cc:203] Tried to move safe_time back from 6445957735037906944 to 6445957734068674560. Current Snapshot: MvccSnapshot[committed={T|T < 6445957735034163200}] 08:29:10.175 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@18317edc, flushNotification=Deferred@1309335839(state=PENDING, result=null, callback=, errback=)} 08:29:10.178 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@238d68ff, flushNotification=Deferred@1267105885(state=PENDING, result=null, callback=, errback=)} 08:29:10.188 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5852c06f, flushNotification=Deferred@1095352419(state=PENDING, result=null, callback=, errback=)} 08:29:10.191 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@9cb8225, flushNotification=Deferred@1991278377(state=PENDING, result=null, callback=, errback=)} 08:29:10.198 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@38af9828, flushNotification=Deferred@929697158(state=PENDING, result=null, callback=, errback=)} 08:29:10.205 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@62656be4, flushNotification=Deferred@400103862(state=PENDING, result=null, callback=, errback=)} 08:29:10.210 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@53f3bdbd, flushNotification=Deferred@873634936(state=PENDING, result=null, callback=, errback=)} 08:29:10.219 [DEBUG - New I/O worker #13] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6d367868, flushNotification=Deferred@674556842(state=PENDING, result=null, callback=, errback=)} 08:29:10.232 [DEBUG - New I/O worker #13] (AsyncKuduScanner.java:1141) AsyncKuduScanner$Response(scannerId = "", data = RowResultIterator for 100 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestAsyncKuduSession, tablet=0b54c5066771476593d702b3975527e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=, endPrimaryKey=) 08:29:10.235 [DEBUG - New I/O worker #12] (Connection.java:691) [peer master-127.27.36.126:45629(127.27.36.126:45629)] cleaning up while in state READY due to: connection disconnected 08:29:10.239 [DEBUG - New I/O worker #11] (Connection.java:691) [peer master-127.27.36.124:36915(127.27.36.124:36915)] cleaning up while in state READY due to: connection disconnected 08:29:10.240 [DEBUG - New I/O worker #13] (Connection.java:691) [peer 734e1fee92d6486bb1a49ce326e2f6eb(127.27.36.65:39385)] cleaning up while in state READY due to: connection disconnected 08:29:10.241 [DEBUG - New I/O worker #10] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:10.244 [DEBUG - New I/O worker #10] (Connection.java:691) [peer master-127.27.36.125:42865(127.27.36.125:42865)] cleaning up while in state READY due to: connection disconnected 08:29:10.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.245170 27793 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 27993 08:29:10.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.251049 27793 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 28133 08:29:10.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.255442 27793 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 28277 08:29:10.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.258916 27793 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 27802 08:29:10.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.262379 27793 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 27864 08:29:10.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.265985 27793 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 27930 08:29:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:10Z chronyd exiting 08:29:10.291 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720150291 08:29:10.294 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:10.294 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:10.294 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:10.294 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:10.295 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:10.296 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558" hms_mode: NONE mini_kdc_options { } } 08:29:10.368 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:10.368 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:10.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:10.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:10Z Disabled control of system clock 08:29:10.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.385592 28456 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:10.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:10.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/wal 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/data 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.62:34397 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.62 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/logs 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/data/info.pb 08:29:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:10.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:10.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.440623 28465 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:10.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.440876 28465 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:10.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.441970 28465 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:10.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.442003 28465 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:10.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.442016 28465 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:10.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.442031 28465 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:10.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.443900 28465 master_main.cc:98] Master server non-default flags: 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/data 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/wal 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:10.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.62:34397 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/data/info.pb 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.62 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.28465 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:10.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/logs 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:10.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.452186 28465 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:10.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.453358 28465 hybrid_clock.cc:181] HybridClock initialized: now 1573720150453301 us; error 60 us; skew 500 ppm 08:29:10.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.453889 28465 fs_manager.cc:261] Metadata directory not provided 08:29:10.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.453951 28465 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:10.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.454227 28465 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:10.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.454257 28465 server_base.cc:453] Attempting to create new FS layout instead 08:29:10.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.456094 28465 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/data/instance: 08:29:10.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "1766de0fd3b74ed4b6a4113a1b54f743" 08:29:10.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.456398 28465 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/wal/instance: 08:29:10.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "1766de0fd3b74ed4b6a4113a1b54f743" 08:29:10.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.461794 28465 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s 08:29:10.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.462760 28465 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:10.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.463320 28465 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:10.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.466768 28465 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:10.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.466886 28465 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/wal 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "1766de0fd3b74ed4b6a4113a1b54f743" 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.466980 28465 fs_report.cc:352] FS layout report 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/wal 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/wal 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/data/data 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:10.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:10.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.497923 28465 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:10.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.503801 28465 rpc_server.cc:211] RPC server started. Bound to: 127.27.202.62:34397 08:29:10.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.504901 28465 webserver.cc:382] Webserver started at http://127.27.202.62:42013/ using document root and password file 08:29:10.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.505575 28465 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-0/data/info.pb 08:29:10.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.508489 28526 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:10.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.511123 28456 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 28465 08:29:10.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.511559 28456 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:10.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:10.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/wal 08:29:10.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/data 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.61:44223 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.61 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/logs 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/data/info.pb 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.512619 28526 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.536923 28526 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.537740 28526 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.202.61:44223: Network error: Client connection negotiation failed: client connection to 127.27.202.61:44223: connect: Connection refused (error 111) 08:29:10.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.556985 28526 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } attempt: 1 08:29:10.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.558054 28526 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.202.61:44223: Network error: Client connection negotiation failed: client connection to 127.27.202.61:44223: connect: Connection refused (error 111) 08:29:10.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:10.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.579993 28527 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:10.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.580200 28527 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:10.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.581182 28527 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:10.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.581209 28527 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:10.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.581216 28527 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:10.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.581224 28527 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.583029 28527 master_main.cc:98] Master server non-default flags: 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/data 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/wal 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.61:44223 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/data/info.pb 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.61 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.28527 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/logs 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:10.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:10.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.590819 28527 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:10.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.591989 28527 hybrid_clock.cc:181] HybridClock initialized: now 1573720150591951 us; error 44 us; skew 500 ppm 08:29:10.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.592537 28527 fs_manager.cc:261] Metadata directory not provided 08:29:10.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.592592 28527 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:10.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.592885 28527 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:10.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.592913 28527 server_base.cc:453] Attempting to create new FS layout instead 08:29:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.594944 28527 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/data/instance: 08:29:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" 08:29:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.595180 28527 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/wal/instance: 08:29:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" 08:29:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.600581 28527 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s 08:29:10.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.601267 28527 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:10.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.601680 28527 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:10.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.604861 28527 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:10.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.604970 28527 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/wal 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.605051 28527 fs_report.cc:352] FS layout report 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/wal 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/wal 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/data/data 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:10.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:10.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.606314 28526 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } attempt: 2 08:29:10.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.607301 28526 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.202.61:44223: Network error: Client connection negotiation failed: client connection to 127.27.202.61:44223: connect: Connection refused (error 111) 08:29:10.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.669628 28527 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:10.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.675396 28527 rpc_server.cc:211] RPC server started. Bound to: 127.27.202.61:44223 08:29:10.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.676317 28527 webserver.cc:382] Webserver started at http://127.27.202.61:39049/ using document root and password file 08:29:10.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.676949 28527 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-1/data/info.pb 08:29:10.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.677529 28456 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 28527 08:29:10.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.677913 28456 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/wal 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/data 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.60:38587 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.60 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/logs 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/data/info.pb 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:10.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.680441 28591 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:10.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.685189 28591 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.693862 28591 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.700083 28591 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.700858 28591 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.202.60:38587: Network error: Client connection negotiation failed: client connection to 127.27.202.60:38587: connect: Connection refused (error 111) 08:29:10.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.718549 28526 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } attempt: 3 08:29:10.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.720142 28591 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } attempt: 1 08:29:10.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.721087 28591 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.202.60:38587: Network error: Client connection negotiation failed: client connection to 127.27.202.60:38587: connect: Connection refused (error 111) 08:29:10.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.723197 28526 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.723882 28526 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.202.60:38587: Network error: Client connection negotiation failed: client connection to 127.27.202.60:38587: connect: Connection refused (error 111) 08:29:10.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:10.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.738759 28592 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:10.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.738976 28592 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.740120 28592 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.740154 28592 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.740166 28592 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.740180 28592 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.742149 28592 master_main.cc:98] Master server non-default flags: 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/data 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/wal 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.60:38587 08:29:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/data/info.pb 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.60 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.28592 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/logs 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:10.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.749132 28592 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:10.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.750325 28592 hybrid_clock.cc:181] HybridClock initialized: now 1573720150750283 us; error 43 us; skew 500 ppm 08:29:10.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.750808 28592 fs_manager.cc:261] Metadata directory not provided 08:29:10.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.750857 28592 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:10.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.751060 28592 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:10.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.751085 28592 server_base.cc:453] Attempting to create new FS layout instead 08:29:10.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.752915 28592 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/data/instance: 08:29:10.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8fce787f806b40f89048d79a7c5cfd4e" 08:29:10.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.753155 28592 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/wal/instance: 08:29:10.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8fce787f806b40f89048d79a7c5cfd4e" 08:29:10.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.757874 28592 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s 08:29:10.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.758563 28592 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:10.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.758937 28592 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.761755 28592 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.761838 28592 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/wal 08:29:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8fce787f806b40f89048d79a7c5cfd4e" 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.761910 28592 fs_report.cc:352] FS layout report 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/wal 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/wal 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/data/data 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:10.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:10.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.769292 28591 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } attempt: 2 08:29:10.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.770364 28591 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.202.60:38587: Network error: Client connection negotiation failed: client connection to 127.27.202.60:38587: connect: Connection refused (error 111) 08:29:10.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.788116 28526 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } attempt: 1 08:29:10.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.789232 28526 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.27.202.60:38587: Network error: Client connection negotiation failed: client connection to 127.27.202.60:38587: connect: Connection refused (error 111) 08:29:10.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.793227 28592 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:10.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.798442 28592 rpc_server.cc:211] RPC server started. Bound to: 127.27.202.60:38587 08:29:10.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.799409 28592 webserver.cc:382] Webserver started at http://127.27.202.60:40713/ using document root and password file 08:29:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.800055 28592 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/master-2/data/info.pb 08:29:10.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.802757 28655 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:10.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.804698 28456 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 28592 08:29:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.805388 28456 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/wal 08:29:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/data 08:29:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.1:0 08:29:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.202.1 08:29:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.1 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/logs 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/data/info.pb 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:10.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:10.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.806218 28655 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.814771 28655 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.818547 28655 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } has no permanent_uuid. Determining permanent_uuid... 08:29:10.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.827977 28655 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e: Bootstrap starting. 08:29:10.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.830606 28655 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e: No blocks or log segments found. Creating new log. 08:29:10.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.831615 28655 log.cc:558] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e: Log is configured to *not* fsync() on all Append() calls 08:29:10.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.833338 28655 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e: No bootstrap required, opened a new log 08:29:10.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.836539 28655 raft_consensus.cc:333] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.836633 28655 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:10.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.836673 28655 raft_consensus.cc:698] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fce787f806b40f89048d79a7c5cfd4e, State: Initialized, Role: FOLLOWER 08:29:10.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.837158 28655 consensus_queue.cc:228] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.837661 28655 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:10.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.837678 28660 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:10.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.837733 28655 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: This master's current role is: FOLLOWER 08:29:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.837746 28660 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: This master's current role is: FOLLOWER 08:29:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.838840 28655 sys_catalog.cc:428] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: configured and running, proceeding with master startup. 08:29:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.845634 28661 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.845679 28661 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.861467 28656 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.861673 28656 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.862475 28656 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.862531 28656 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.202.1 08:29:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.864102 28656 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/data 08:29:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/wal 08:29:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.1:0 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/data/info.pb 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.1 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.28656 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.202.1 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/logs 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:10.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.868475 28526 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } attempt: 2 08:29:10.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.872527 28656 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.875716 28526 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743: Bootstrap starting. 08:29:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.875826 28656 hybrid_clock.cc:181] HybridClock initialized: now 1573720150875770 us; error 50 us; skew 500 ppm 08:29:10.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.876368 28656 fs_manager.cc:261] Metadata directory not provided 08:29:10.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.876420 28656 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:10.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.876724 28656 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:10.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.876752 28656 server_base.cc:453] Attempting to create new FS layout instead 08:29:10.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.878083 28526 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743: No blocks or log segments found. Creating new log. 08:29:10.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.878690 28656 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/data/instance: 08:29:10.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c4490cc6924e416480d2dfd9642e4468" 08:29:10.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.879004 28656 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/wal/instance: 08:29:10.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c4490cc6924e416480d2dfd9642e4468" 08:29:10.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.879045 28526 log.cc:558] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743: Log is configured to *not* fsync() on all Append() calls 08:29:10.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.882010 28526 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743: No bootstrap required, opened a new log 08:29:10.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.884867 28591 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } attempt: 3 08:29:10.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.885465 28526 raft_consensus.cc:333] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.885546 28526 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.885597 28526 raft_consensus.cc:698] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1766de0fd3b74ed4b6a4113a1b54f743, State: Initialized, Role: FOLLOWER 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.885700 28656 fs_manager.cc:508] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.886157 28526 consensus_queue.cc:228] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.886443 28656 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.886571 28526 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.886600 28526 sys_catalog.cc:343] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: This master's current role is: FOLLOWER 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.886921 28656 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.887560 28526 sys_catalog.cc:428] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: configured and running, proceeding with master startup. 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.889039 28670 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:10.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.889072 28670 sys_catalog.cc:343] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: This master's current role is: FOLLOWER 08:29:10.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.892035 28672 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:10.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.892076 28672 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:10.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.893501 28591 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9: Bootstrap starting. 08:29:10.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.895782 28591 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9: No blocks or log segments found. Creating new log. 08:29:10.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.896770 28591 log.cc:558] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9: Log is configured to *not* fsync() on all Append() calls 08:29:10.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.898874 28591 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9: No bootstrap required, opened a new log 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.898932 28656 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.899058 28656 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/wal 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c4490cc6924e416480d2dfd9642e4468" 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:10 on dist-test-slave-dist-test-slave-05kx" 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.899166 28656 fs_report.cc:352] FS layout report 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/wal 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/wal 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/data/data 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:10.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.902570 28591 raft_consensus.cc:333] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.902657 28591 raft_consensus.cc:359] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.902700 28591 raft_consensus.cc:698] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ee4b93e5ee40e2b7a564d56fe498a9, State: Initialized, Role: FOLLOWER 08:29:10.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.905341 28591 consensus_queue.cc:228] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.905725 28591 sys_catalog.cc:340] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.905753 28591 sys_catalog.cc:343] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.906767 28591 sys_catalog.cc:428] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: configured and running, proceeding with master startup. 08:29:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.907568 28676 sys_catalog.cc:340] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.907605 28676 sys_catalog.cc:343] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:10.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.912351 28677 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:10.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.916847 28677 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:10.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.920891 28547 tablet.cc:1764] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:10.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.920939 28656 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:10.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.922413 28656 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:10.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.922649 28656 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:10.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.933755 28656 rpc_server.cc:211] RPC server started. Bound to: 127.27.202.1:38027 08:29:10.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.936162 28656 webserver.cc:382] Webserver started at http://127.27.202.1:41897/ using document root and password file 08:29:10.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.937450 28656 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-0/data/info.pb 08:29:10.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.941475 28456 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 28656 08:29:10.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.942227 28456 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:10.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/wal 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/data 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.2:0 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.202.2 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.2 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/logs 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/data/info.pb 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:10.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:10.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:10.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.954342 28792 heartbeater.cc:322] Connected to a master server at 127.27.202.60:38587 08:29:10.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.954679 28792 heartbeater.cc:406] Registering TS with master... 08:29:10.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.955296 28792 heartbeater.cc:455] Master 127.27.202.60:38587 requested a full tablet report, sending... 08:29:10.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.955529 28793 heartbeater.cc:322] Connected to a master server at 127.27.202.61:44223 08:29:10.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.955924 28793 heartbeater.cc:406] Registering TS with master... 08:29:10.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.956272 28793 heartbeater.cc:455] Master 127.27.202.61:44223 requested a full tablet report, sending... 08:29:10.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.957111 28622 ts_manager.cc:191] Registered new tserver with Master: c4490cc6924e416480d2dfd9642e4468 (127.27.202.1:38027) 08:29:10.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.957352 28794 heartbeater.cc:322] Connected to a master server at 127.27.202.62:34397 08:29:10.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.957398 28794 heartbeater.cc:406] Registering TS with master... 08:29:10.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.957569 28794 heartbeater.cc:455] Master 127.27.202.62:34397 requested a full tablet report, sending... 08:29:10.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.957656 28558 ts_manager.cc:191] Registered new tserver with Master: c4490cc6924e416480d2dfd9642e4468 (127.27.202.1:38027) 08:29:10.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.959048 28493 ts_manager.cc:191] Registered new tserver with Master: c4490cc6924e416480d2dfd9642e4468 (127.27.202.1:38027) 08:29:10.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.976958 28660 raft_consensus.cc:465] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:10.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.977211 28660 raft_consensus.cc:487] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.978368 28660 leader_election.cc:296] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1766de0fd3b74ed4b6a4113a1b54f743 (127.27.202.62:34397), 14ee4b93e5ee40e2b7a564d56fe498a9 (127.27.202.61:44223) 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.979380 28563 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fce787f806b40f89048d79a7c5cfd4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" is_pre_election: true 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.979372 28503 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fce787f806b40f89048d79a7c5cfd4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" is_pre_election: true 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.979599 28503 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fce787f806b40f89048d79a7c5cfd4e in term 0. 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.979607 28563 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fce787f806b40f89048d79a7c5cfd4e in term 0. 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.980114 28602 leader_election.cc:310] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1766de0fd3b74ed4b6a4113a1b54f743, 8fce787f806b40f89048d79a7c5cfd4e; no voters: 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.980638 28660 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.980681 28660 raft_consensus.cc:465] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:10.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.980705 28660 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 0 FOLLOWER]: Advancing to term 1 08:29:10.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.981879 28660 raft_consensus.cc:487] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.982209 28660 leader_election.cc:296] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [CANDIDATE]: Term 1 election: Requested vote from peers 1766de0fd3b74ed4b6a4113a1b54f743 (127.27.202.62:34397), 14ee4b93e5ee40e2b7a564d56fe498a9 (127.27.202.61:44223) 08:29:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.982522 28503 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fce787f806b40f89048d79a7c5cfd4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" 08:29:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.982589 28503 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [term 0 FOLLOWER]: Advancing to term 1 08:29:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.982743 28563 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fce787f806b40f89048d79a7c5cfd4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" 08:29:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.982805 28563 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [term 0 FOLLOWER]: Advancing to term 1 08:29:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.983724 28503 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fce787f806b40f89048d79a7c5cfd4e in term 1. 08:29:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.983922 28563 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fce787f806b40f89048d79a7c5cfd4e in term 1. 08:29:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.984059 28602 leader_election.cc:310] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1766de0fd3b74ed4b6a4113a1b54f743, 8fce787f806b40f89048d79a7c5cfd4e; no voters: 08:29:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.984210 28660 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 1 FOLLOWER]: Leader election won for term 1 08:29:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.984477 28660 raft_consensus.cc:660] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [term 1 LEADER]: Becoming Leader. State: Replica: 8fce787f806b40f89048d79a7c5cfd4e, State: Running, Role: LEADER 08:29:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.984930 28660 consensus_queue.cc:205] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } 08:29:10.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.986605 28660 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fce787f806b40f89048d79a7c5cfd4e. Latest consensus state: current_term: 1 leader_uuid: "8fce787f806b40f89048d79a7c5cfd4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:10.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.986639 28660 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: This master's current role is: LEADER 08:29:10.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.993028 28803 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:10.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:10.994421 28803 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:10.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:10.999514 28482 tablet.cc:1764] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:11.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.044456 28611 tablet.cc:1764] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.083787 28503 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [term 1 FOLLOWER]: Refusing update from remote peer 8fce787f806b40f89048d79a7c5cfd4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.083787 28563 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [term 1 FOLLOWER]: Refusing update from remote peer 8fce787f806b40f89048d79a7c5cfd4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.083797 28797 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.084034 28797 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.084892 28801 consensus_queue.cc:981] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.085017 28805 consensus_queue.cc:981] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:11.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.089253 28670 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fce787f806b40f89048d79a7c5cfd4e. Latest consensus state: current_term: 1 leader_uuid: "8fce787f806b40f89048d79a7c5cfd4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:11.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.089287 28670 sys_catalog.cc:343] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: This master's current role is: FOLLOWER 08:29:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.089371 28797 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.089465 28797 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.202.2 08:29:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.089742 28676 sys_catalog.cc:340] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fce787f806b40f89048d79a7c5cfd4e. Latest consensus state: current_term: 1 leader_uuid: "8fce787f806b40f89048d79a7c5cfd4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.089763 28676 sys_catalog.cc:343] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.091702 28797 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/data 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/wal 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.2:0 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/data/info.pb 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.2 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.28797 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.202.2 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/logs 08:29:11.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:11.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.098630 28804 mvcc.cc:203] Tried to move safe_time back from 6445957738829176832 to 6445957738437009408. Current Snapshot: MvccSnapshot[committed={T|T < 6445957738829176832}] 08:29:11.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.098809 28801 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fce787f806b40f89048d79a7c5cfd4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.098847 28801 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: This master's current role is: LEADER 08:29:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.098816 28660 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fce787f806b40f89048d79a7c5cfd4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.098924 28660 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e [sys.catalog]: This master's current role is: LEADER 08:29:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.099108 28670 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8fce787f806b40f89048d79a7c5cfd4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.099133 28670 sys_catalog.cc:343] T 00000000000000000000000000000000 P 1766de0fd3b74ed4b6a4113a1b54f743 [sys.catalog]: This master's current role is: FOLLOWER 08:29:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.099839 28806 mvcc.cc:203] Tried to move safe_time back from 6445957738829176832 to 6445957738437009408. Current Snapshot: MvccSnapshot[committed={T|T < 6445957738829176832}] 08:29:11.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.100399 28676 sys_catalog.cc:340] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8fce787f806b40f89048d79a7c5cfd4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1766de0fd3b74ed4b6a4113a1b54f743" member_type: VOTER last_known_addr { host: "127.27.202.62" port: 34397 } } peers { permanent_uuid: "14ee4b93e5ee40e2b7a564d56fe498a9" member_type: VOTER last_known_addr { host: "127.27.202.61" port: 44223 } } peers { permanent_uuid: "8fce787f806b40f89048d79a7c5cfd4e" member_type: VOTER last_known_addr { host: "127.27.202.60" port: 38587 } } } 08:29:11.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.100432 28676 sys_catalog.cc:343] T 00000000000000000000000000000000 P 14ee4b93e5ee40e2b7a564d56fe498a9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:11.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.104465 28803 catalog_manager.cc:985] Generated new certificate authority record 08:29:11.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.106035 28803 catalog_manager.cc:1110] Loading token signing keys... 08:29:11.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.108721 28797 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:11.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.114004 28797 hybrid_clock.cc:181] HybridClock initialized: now 1573720151113933 us; error 43 us; skew 500 ppm 08:29:11.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.114780 28797 fs_manager.cc:261] Metadata directory not provided 08:29:11.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.114838 28797 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:11.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.115195 28797 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:11.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.115232 28797 server_base.cc:453] Attempting to create new FS layout instead 08:29:11.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.117754 28797 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/data/instance: 08:29:11.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "b093570aef20414b8d2f9402f7c642d9" 08:29:11.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:11 on dist-test-slave-dist-test-slave-05kx" 08:29:11.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.118057 28797 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/wal/instance: 08:29:11.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "b093570aef20414b8d2f9402f7c642d9" 08:29:11.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:11 on dist-test-slave-dist-test-slave-05kx" 08:29:11.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.126379 28797 fs_manager.cc:508] Time spent creating directory manager: real 0.008s user 0.003s sys 0.004s 08:29:11.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.126977 28797 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:11.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.127382 28797 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:11.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.131304 28803 catalog_manager.cc:4455] T 00000000000000000000000000000000 P 8fce787f806b40f89048d79a7c5cfd4e: Generated new TSK 0 08:29:11.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.131507 28797 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:11.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.131774 28797 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/wal 08:29:11.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "b093570aef20414b8d2f9402f7c642d9" 08:29:11.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:11 on dist-test-slave-dist-test-slave-05kx" 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.132052 28803 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.132287 28797 fs_report.cc:352] FS layout report 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/wal 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/wal 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/data/data 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:11.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:11.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:11.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:11.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:11.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:11.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:11.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:11.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:11.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.195647 28797 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:11.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.196940 28797 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:11.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.196970 28797 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:11.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.205737 28797 rpc_server.cc:211] RPC server started. Bound to: 127.27.202.2:40135 08:29:11.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.206825 28797 webserver.cc:382] Webserver started at http://127.27.202.2:34957/ using document root and password file 08:29:11.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.207458 28797 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-1/data/info.pb 08:29:11.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.216699 28935 heartbeater.cc:322] Connected to a master server at 127.27.202.60:38587 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.216702 28937 heartbeater.cc:322] Connected to a master server at 127.27.202.62:34397 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.216825 28456 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 28797 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.216910 28937 heartbeater.cc:406] Registering TS with master... 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.216912 28935 heartbeater.cc:406] Registering TS with master... 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.217375 28456 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/wal 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/data 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.3:0 08:29:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.202.3 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.3 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/logs 08:29:11.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/data/info.pb 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.217442 28937 heartbeater.cc:455] Master 127.27.202.62:34397 requested a full tablet report, sending... 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.217447 28935 heartbeater.cc:455] Master 127.27.202.60:38587 requested a full tablet report, sending... 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.218498 28493 ts_manager.cc:191] Registered new tserver with Master: b093570aef20414b8d2f9402f7c642d9 (127.27.202.2:40135) 08:29:11.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.218495 28622 ts_manager.cc:191] Registered new tserver with Master: b093570aef20414b8d2f9402f7c642d9 (127.27.202.2:40135) 08:29:11.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.219599 28936 heartbeater.cc:322] Connected to a master server at 127.27.202.61:44223 08:29:11.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.219642 28936 heartbeater.cc:406] Registering TS with master... 08:29:11.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.219784 28936 heartbeater.cc:455] Master 127.27.202.61:44223 requested a full tablet report, sending... 08:29:11.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.220392 28558 ts_manager.cc:191] Registered new tserver with Master: b093570aef20414b8d2f9402f7c642d9 (127.27.202.2:40135) 08:29:11.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.220468 28622 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.27.202.2:57177 08:29:11.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:11.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.269940 28942 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:11.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.270184 28942 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:11.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.271194 28942 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:11.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.271281 28942 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.202.3 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.273139 28942 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.27.202.20:45377 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/data 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/wal 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.27.202.3:0 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/data/info.pb 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.27.202.3 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.27.202.62:34397,127.27.202.61:44223,127.27.202.60:38587 08:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.28942 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.27.202.3 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/logs 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:11.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.282685 28942 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:11.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.283877 28942 hybrid_clock.cc:181] HybridClock initialized: now 1573720151283853 us; error 27 us; skew 500 ppm 08:29:11.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.284423 28942 fs_manager.cc:261] Metadata directory not provided 08:29:11.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.284485 28942 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:11.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.284765 28942 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:11.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.284842 28942 server_base.cc:453] Attempting to create new FS layout instead 08:29:11.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.286790 28942 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/data/instance: 08:29:11.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" 08:29:11.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:11 on dist-test-slave-dist-test-slave-05kx" 08:29:11.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.287115 28942 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/wal/instance: 08:29:11.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" 08:29:11.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:11 on dist-test-slave-dist-test-slave-05kx" 08:29:11.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.292254 28942 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s 08:29:11.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.293143 28942 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:11.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.293581 28942 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.296577 28942 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s 08:29:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.296684 28942 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/wal 08:29:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" 08:29:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:11 on dist-test-slave-dist-test-slave-05kx" 08:29:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.296757 28942 fs_report.cc:352] FS layout report 08:29:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/wal 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/wal 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/data/data 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.349354 28942 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:11.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.350525 28942 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:11.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.350562 28942 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:11.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.356422 28942 rpc_server.cc:211] RPC server started. Bound to: 127.27.202.3:33919 08:29:11.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.358378 28942 webserver.cc:382] Webserver started at http://127.27.202.3:45319/ using document root and password file 08:29:11.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.358814 28942 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3719103107805242558/ts-2/data/info.pb 08:29:11.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.364444 28456 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 28942 08:29:11.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.368387 29066 heartbeater.cc:322] Connected to a master server at 127.27.202.62:34397 08:29:11.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.368726 29066 heartbeater.cc:406] Registering TS with master... 08:29:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.369168 29065 heartbeater.cc:322] Connected to a master server at 127.27.202.61:44223 08:29:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.369379 29066 heartbeater.cc:455] Master 127.27.202.62:34397 requested a full tablet report, sending... 08:29:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.369453 29065 heartbeater.cc:406] Registering TS with master... 08:29:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.369549 29064 heartbeater.cc:322] Connected to a master server at 127.27.202.60:38587 08:29:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.369647 29064 heartbeater.cc:406] Registering TS with master... 08:29:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.369837 29064 heartbeater.cc:455] Master 127.27.202.60:38587 requested a full tablet report, sending... 08:29:11.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.370085 29065 heartbeater.cc:455] Master 127.27.202.61:44223 requested a full tablet report, sending... 08:29:11.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.370687 28493 ts_manager.cc:191] Registered new tserver with Master: c2e22fb82d534aafba7f51ec0f2c9ef5 (127.27.202.3:33919) 08:29:11.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.370743 28558 ts_manager.cc:191] Registered new tserver with Master: c2e22fb82d534aafba7f51ec0f2c9ef5 (127.27.202.3:33919) 08:29:11.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.371387 28622 ts_manager.cc:191] Registered new tserver with Master: c2e22fb82d534aafba7f51ec0f2c9ef5 (127.27.202.3:33919) 08:29:11.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.372114 28622 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.27.202.3:42765 08:29:11.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.383309 28456 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:11.383 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:11.383 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:11.384 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.27.202.62" port: 34397 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.27.202.61" port: 44223 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.27.202.60" port: 38587 } } } 08:29:11.385 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:11.385 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.27.202.1" port: 38027 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.27.202.2" port: 40135 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.27.202.3" port: 33919 } } } 08:29:11.390 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:11.404 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:11.411 [DEBUG - New I/O worker #19] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.27.202.61 08:29:11.412 [DEBUG - New I/O worker #21] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.27.202.60 08:29:11.414 [DEBUG - New I/O worker #20] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.27.202.62 08:29:11.422 [DEBUG - New I/O worker #21] (Negotiator.java:764) Authenticated connection [id: 0x4a2dc153, /127.0.0.1:34530 => /127.27.202.60:38587] using SASL/PLAIN 08:29:11.426 [DEBUG - New I/O worker #21] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:11.427 [DEBUG - New I/O worker #21] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=22), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.202.61:44223, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.202.62:34397, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.202.60:38587, [18ms] Sub RPC ConnectToMaster: received response from server master-127.27.202.60:38587: OK, deferred=null) after lookup 08:29:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.430474 28622 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34530: 08:29:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.431972 28622 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:11.435 [DEBUG - New I/O worker #20] (Negotiator.java:764) Authenticated connection [id: 0xbfd9652d, /127.0.0.1:50602 => /127.27.202.62:34397] using SASL/PLAIN 08:29:11.437 [DEBUG - New I/O worker #19] (Negotiator.java:764) Authenticated connection [id: 0xcc9ec496, /127.0.0.1:34720 => /127.27.202.61:44223] using SASL/PLAIN 08:29:11.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.454455 28721 tablet_service.cc:1023] Processing CreateTablet for tablet 123cdb9f6f074d38a948da5da4eb74dd (table=org.apache.kudu.client.TestAsyncKuduSession [id=039348aa2bd24794aefcf9194bb304ef]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:11.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.454720 28862 tablet_service.cc:1023] Processing CreateTablet for tablet 123cdb9f6f074d38a948da5da4eb74dd (table=org.apache.kudu.client.TestAsyncKuduSession [id=039348aa2bd24794aefcf9194bb304ef]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:11.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.455107 28721 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 123cdb9f6f074d38a948da5da4eb74dd. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:11.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.455124 28862 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 123cdb9f6f074d38a948da5da4eb74dd. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:11.459 [DEBUG - New I/O worker #21] (AsyncKuduClient.java:777) Opened table 039348aa2bd24794aefcf9194bb304ef 08:29:11.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.457844 29000 tablet_service.cc:1023] Processing CreateTablet for tablet 123cdb9f6f074d38a948da5da4eb74dd (table=org.apache.kudu.client.TestAsyncKuduSession [id=039348aa2bd24794aefcf9194bb304ef]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:11.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.458406 29000 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 123cdb9f6f074d38a948da5da4eb74dd. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:11.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.462613 29090 tablet_bootstrap.cc:439] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9: Bootstrap starting. 08:29:11.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.462621 29089 tablet_bootstrap.cc:439] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468: Bootstrap starting. 08:29:11.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.464579 29090 tablet_bootstrap.cc:590] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9: No blocks or log segments found. Creating new log. 08:29:11.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.464579 29089 tablet_bootstrap.cc:590] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468: No blocks or log segments found. Creating new log. 08:29:11.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.465270 29091 tablet_bootstrap.cc:439] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5: Bootstrap starting. 08:29:11.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.465668 29089 log.cc:558] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468: Log is configured to *not* fsync() on all Append() calls 08:29:11.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.466852 29091 tablet_bootstrap.cc:590] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5: No blocks or log segments found. Creating new log. 08:29:11.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.467013 29089 tablet_bootstrap.cc:439] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468: No bootstrap required, opened a new log 08:29:11.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.467197 29089 ts_tablet_manager.cc:1096] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s 08:29:11.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.467882 29090 log.cc:558] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9: Log is configured to *not* fsync() on all Append() calls 08:29:11.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.469138 29090 tablet_bootstrap.cc:439] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9: No bootstrap required, opened a new log 08:29:11.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.469552 29090 ts_tablet_manager.cc:1096] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s 08:29:11.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.470353 29089 raft_consensus.cc:333] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.470614 29089 raft_consensus.cc:359] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.470655 29089 raft_consensus.cc:698] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4490cc6924e416480d2dfd9642e4468, State: Initialized, Role: FOLLOWER 08:29:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.471143 29089 consensus_queue.cc:228] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.472303 29090 raft_consensus.cc:333] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.472368 29090 raft_consensus.cc:359] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.472398 29090 raft_consensus.cc:698] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b093570aef20414b8d2f9402f7c642d9, State: Initialized, Role: FOLLOWER 08:29:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.473096 29091 log.cc:558] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5: Log is configured to *not* fsync() on all Append() calls 08:29:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.473686 29090 consensus_queue.cc:228] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.474253 28935 heartbeater.cc:447] Master 127.27.202.60:38587 was elected leader, sending a full tablet report... 08:29:11.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.475790 29091 tablet_bootstrap.cc:439] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5: No bootstrap required, opened a new log 08:29:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.476116 29091 ts_tablet_manager.cc:1096] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s 08:29:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.476512 28622 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.27.202.1:41467 08:29:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.476678 29090 ts_tablet_manager.cc:1124] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s 08:29:11.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.478598 29091 raft_consensus.cc:333] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.478672 29091 raft_consensus.cc:359] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:11.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.478677 28792 heartbeater.cc:447] Master 127.27.202.60:38587 was elected leader, sending a full tablet report... 08:29:11.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.478705 29091 raft_consensus.cc:698] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e22fb82d534aafba7f51ec0f2c9ef5, State: Initialized, Role: FOLLOWER 08:29:11.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.479635 29089 ts_tablet_manager.cc:1124] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468: Time spent starting tablet: real 0.012s user 0.004s sys 0.001s 08:29:11.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.481722 29091 consensus_queue.cc:228] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.482192 29064 heartbeater.cc:447] Master 127.27.202.60:38587 was elected leader, sending a full tablet report... 08:29:11.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.484113 29091 ts_tablet_manager.cc:1124] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s 08:29:11.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.610577 29067 tablet.cc:1764] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:11.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.696574 28795 tablet.cc:1764] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:11.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.709158 28938 tablet.cc:1764] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.772749 29096 raft_consensus.cc:465] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:11.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.773072 29096 raft_consensus.cc:487] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.774322 29096 leader_election.cc:296] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4490cc6924e416480d2dfd9642e4468 (127.27.202.1:38027), c2e22fb82d534aafba7f51ec0f2c9ef5 (127.27.202.3:33919) 08:29:11.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.779431 29020 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "123cdb9f6f074d38a948da5da4eb74dd" candidate_uuid: "b093570aef20414b8d2f9402f7c642d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" is_pre_election: true 08:29:11.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.779659 29020 raft_consensus.cc:2355] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b093570aef20414b8d2f9402f7c642d9 in term 0. 08:29:11.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.779773 28744 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "123cdb9f6f074d38a948da5da4eb74dd" candidate_uuid: "b093570aef20414b8d2f9402f7c642d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4490cc6924e416480d2dfd9642e4468" is_pre_election: true 08:29:11.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.779943 28744 raft_consensus.cc:2355] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b093570aef20414b8d2f9402f7c642d9 in term 0. 08:29:11.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.780228 28822 leader_election.cc:310] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b093570aef20414b8d2f9402f7c642d9, c2e22fb82d534aafba7f51ec0f2c9ef5; no voters: 08:29:11.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.780510 29096 raft_consensus.cc:2649] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:11.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.780573 29096 raft_consensus.cc:465] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:11.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.780597 29096 raft_consensus.cc:2901] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 0 FOLLOWER]: Advancing to term 1 08:29:11.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.781864 29096 raft_consensus.cc:487] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.782166 29096 leader_election.cc:296] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [CANDIDATE]: Term 1 election: Requested vote from peers c4490cc6924e416480d2dfd9642e4468 (127.27.202.1:38027), c2e22fb82d534aafba7f51ec0f2c9ef5 (127.27.202.3:33919) 08:29:11.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.782598 28744 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "123cdb9f6f074d38a948da5da4eb74dd" candidate_uuid: "b093570aef20414b8d2f9402f7c642d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4490cc6924e416480d2dfd9642e4468" 08:29:11.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.782598 29020 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "123cdb9f6f074d38a948da5da4eb74dd" candidate_uuid: "b093570aef20414b8d2f9402f7c642d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" 08:29:11.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.782668 29020 raft_consensus.cc:2901] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5 [term 0 FOLLOWER]: Advancing to term 1 08:29:11.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.782668 28744 raft_consensus.cc:2901] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468 [term 0 FOLLOWER]: Advancing to term 1 08:29:11.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.783749 28744 raft_consensus.cc:2355] T 123cdb9f6f074d38a948da5da4eb74dd P c4490cc6924e416480d2dfd9642e4468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b093570aef20414b8d2f9402f7c642d9 in term 1. 08:29:11.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.783749 29020 raft_consensus.cc:2355] T 123cdb9f6f074d38a948da5da4eb74dd P c2e22fb82d534aafba7f51ec0f2c9ef5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b093570aef20414b8d2f9402f7c642d9 in term 1. 08:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.784094 28822 leader_election.cc:310] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b093570aef20414b8d2f9402f7c642d9, c2e22fb82d534aafba7f51ec0f2c9ef5; no voters: 08:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.784276 29096 raft_consensus.cc:2649] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 1 FOLLOWER]: Leader election won for term 1 08:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.784489 29096 raft_consensus.cc:660] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [term 1 LEADER]: Becoming Leader. State: Replica: b093570aef20414b8d2f9402f7c642d9, State: Running, Role: LEADER 08:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.784891 29096 consensus_queue.cc:205] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } } 08:29:11.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.788522 28617 catalog_manager.cc:4143] T 123cdb9f6f074d38a948da5da4eb74dd P b093570aef20414b8d2f9402f7c642d9 reported cstate change: term changed from 0 to 1, leader changed from to b093570aef20414b8d2f9402f7c642d9 (127.27.202.2). New cstate: current_term: 1 leader_uuid: "b093570aef20414b8d2f9402f7c642d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4490cc6924e416480d2dfd9642e4468" member_type: VOTER last_known_addr { host: "127.27.202.1" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b093570aef20414b8d2f9402f7c642d9" member_type: VOTER last_known_addr { host: "127.27.202.2" port: 40135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2e22fb82d534aafba7f51ec0f2c9ef5" member_type: VOTER last_known_addr { host: "127.27.202.3" port: 33919 } health_report { overall_health: UNKNOWN } } } 08:29:11.809 [INFO - main] (MiniKuduCluster.java:368) Killing tablet server 127.27.202.3:33919 08:29:11.811 [DEBUG - main] (MiniKuduCluster.java:155) Request: stop_daemon { id { type: TSERVER index: 2 } } 08:29:11.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.811985 28456 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 28942 08:29:11.816 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:11.816 [INFO - main] (MiniKuduCluster.java:368) Killing tablet server 127.27.202.1:38027 08:29:11.816 [DEBUG - main] (MiniKuduCluster.java:155) Request: stop_daemon { id { type: TSERVER index: 0 } } 08:29:11.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.816918 28456 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 28656 08:29:11.820 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:11.821 [INFO - main] (MiniKuduCluster.java:368) Killing tablet server 127.27.202.2:40135 08:29:11.821 [DEBUG - main] (MiniKuduCluster.java:155) Request: stop_daemon { id { type: TSERVER index: 1 } } 08:29:11.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.821792 28456 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 28797 08:29:11.825 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:11.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.828310 28617 rpcz_store.cc:253] Call kudu.master.MasterService.GetTableLocations from 127.0.0.1:34530 (request call id 12) took 1 ms (1 ms). Client timeout 1 ms (1 ms) 08:29:11.828 [DEBUG - Hashed wheel timer #3] (KuduRpc.java:258) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=1, elapsed=2), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.27.202.60:38587, deferred=null) with no deferred attached! 08:29:11.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:11.828883 28617 rpcz_store.cc:259] Trace: 08:29:11.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1114 08:29:11.827252 (+ 0us) service_pool.cc:162] Inserting onto call queue 08:29:11.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1114 08:29:11.827343 (+ 91us) service_pool.cc:221] Handling call 08:29:11.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1114 08:29:11.827548 (+ 205us) catalog_manager.cc:1847] Looking up, locking, and authorizing table 08:29:11.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1114 08:29:11.828239 (+ 691us) inbound_call.cc:162] Queueing success response 08:29:11.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Metrics: {} 08:29:11.830 [DEBUG - New I/O worker #21] (KuduRpc.java:258) Handling a callback on RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=0, TimeoutTracker(timeout=0, elapsed=1), Traces: [0ms] received response from server master-127.27.202.60:38587: OK, deferred=null) with no deferred attached! 08:29:11.829 [DEBUG - Hashed wheel timer #3] (AsyncKuduClient.java:1348) Notify RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=1, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.27.202.60:38587, deferred=null) after lookup exception org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=1, TimeoutTracker(timeout=1, elapsed=2), Traces: [0ms] sending RPC to server master-127.27.202.60:38587, deferred=Deferred@1203417073(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestAsyncKuduSession -> release master lookup permit -> retry RPC -> org.apache.kudu.client.AsyncKuduSession$$Lambda$20/1893960929@497d4976 -> passthrough -> wakeup thread main, errback=passthrough -> release master lookup permit -> retry RPC after error -> passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4d42c481 -> wakeup thread main)) at org.apache.kudu.client.KuduRpc$RpcTimeoutTask.run(KuduRpc.java:457) [main/:?] at org.jboss.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:556) [netty-3.10.6.Final.jar:?] at org.jboss.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:632) [netty-3.10.6.Final.jar:?] at org.jboss.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:369) [netty-3.10.6.Final.jar:?] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [netty-3.10.6.Final.jar:?] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_141] 08:29:11.837 [DEBUG - Hashed wheel timer #3] (KuduRpc.java:258) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=1, elapsed=11), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.27.202.60:38587, deferred=null) with no deferred attached! 08:29:11.839 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@749282235(state=PENDING, result=null, callback=, errback=)} 08:29:11.841 [DEBUG - New I/O worker #21] (AsyncKuduClient.java:2346) Learned about tablet 123cdb9f6f074d38a948da5da4eb74dd for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:11.842 [DEBUG - New I/O worker #21] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=123cdb9f6f074d38a948da5da4eb74dd@[b093570aef20414b8d2f9402f7c642d9(127.27.202.2:40135)[L],c2e22fb82d534aafba7f51ec0f2c9ef5(127.27.202.3:33919),c4490cc6924e416480d2dfd9642e4468(127.27.202.1:38027)]}] 08:29:11.844 [DEBUG - New I/O worker #22] (Connection.java:691) [peer b093570aef20414b8d2f9402f7c642d9(127.27.202.2:40135)] cleaning up while in state CONNECTING due to: java.net.ConnectException: Connection refused: /127.27.202.2:40135 08:29:11.845 [INFO - New I/O worker #22] (AsyncKuduClient.java:2157) Invalidating location b093570aef20414b8d2f9402f7c642d9(127.27.202.2:40135) for tablet 123cdb9f6f074d38a948da5da4eb74dd: java.net.ConnectException: Connection refused: /127.27.202.2:40135 08:29:11.845 [INFO - New I/O boss #27] (Connection.java:444) Failed to connect to peer b093570aef20414b8d2f9402f7c642d9(127.27.202.2:40135): Connection refused: /127.27.202.2:40135 08:29:11.846 [DEBUG - New I/O worker #22] (AsyncKuduClient.java:1691) Cannot continue with RPC because of: Timed out: cannot complete before timeout: Batch{operations=1, tablet="123cdb9f6f074d38a948da5da4eb74dd" [, ), ignoredErrors=[], rpc=KuduRpc(method=Write, tablet=123cdb9f6f074d38a948da5da4eb74dd, attempt=1, TimeoutTracker(timeout=1, elapsed=3), Traces: [0ms] sending RPC to server b093570aef20414b8d2f9402f7c642d9, [3ms] received response from server b093570aef20414b8d2f9402f7c642d9: Network error: java.net.ConnectException: Connection refused: /127.27.202.2:40135, [3ms] delaying RPC due to: Network error: java.net.ConnectException: Connection refused: /127.27.202.2:40135, deferred=Deferred@1607137019(state=PENDING, result=null, callback=apply batch response -> notify DeferredGroup@1359811442, errback=apply batch error response -> notify DeferredGroup@1359811442))} 08:29:11.849 [DEBUG - Hashed wheel timer #3] (KuduRpc.java:258) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=1, elapsed=11), Traces: [0ms] sending RPC to server master-127.27.202.60:38587, [3ms] received response from server master-127.27.202.60:38587: OK, deferred=null) with no deferred attached! 08:29:11.850 [DEBUG - New I/O worker #19] (Connection.java:691) [peer master-127.27.202.61:44223(127.27.202.61:44223)] cleaning up while in state READY due to: connection disconnected 08:29:11.851 [DEBUG - New I/O worker #20] (Connection.java:691) [peer master-127.27.202.62:34397(127.27.202.62:34397)] cleaning up while in state READY due to: connection disconnected 08:29:11.852 [DEBUG - New I/O worker #21] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:11.853 [DEBUG - New I/O worker #21] (Connection.java:691) [peer master-127.27.202.60:38587(127.27.202.60:38587)] cleaning up while in state READY due to: connection disconnected 08:29:11.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.853736 28456 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 28465 08:29:11.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.859016 28456 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 28527 08:29:11.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.862362 28456 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 28592 08:29:11.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:11Z chronyd exiting 08:29:11.886 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720151886 08:29:11.889 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:11.889 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:11.889 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:11.890 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:11.890 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:11.891 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046" hms_mode: NONE mini_kdc_options { } } 08:29:11.970 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:11.971 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:11.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:11.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:11Z Disabled control of system clock 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:11.989935 29104 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/wal 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/data 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.62:35143 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.62 08:29:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/logs 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/data/info.pb 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:12.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:12.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.050417 29113 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:12.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.050635 29113 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:12.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.051585 29113 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:12.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.051614 29113 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:12.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.051620 29113 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:12.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.051645 29113 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.053488 29113 master_main.cc:98] Master server non-default flags: 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/data 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/wal 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.62:35143 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/data/info.pb 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.62 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.29113 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/logs 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:12.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:12.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.061091 29113 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:12.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.062255 29113 hybrid_clock.cc:181] HybridClock initialized: now 1573720152062226 us; error 38 us; skew 500 ppm 08:29:12.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.062774 29113 fs_manager.cc:261] Metadata directory not provided 08:29:12.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.062819 29113 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:12.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.063045 29113 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:12.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.063071 29113 server_base.cc:453] Attempting to create new FS layout instead 08:29:12.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.065050 29113 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/data/instance: 08:29:12.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5093330e1f024852adca002d2264c30d" 08:29:12.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.065294 29113 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/wal/instance: 08:29:12.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5093330e1f024852adca002d2264c30d" 08:29:12.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.070477 29113 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s 08:29:12.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.071262 29113 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:12.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.071751 29113 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.074892 29113 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.074986 29113 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/wal 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5093330e1f024852adca002d2264c30d" 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.075064 29113 fs_report.cc:352] FS layout report 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/wal 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/wal 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/data/data 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:12.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:12.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.103762 29113 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:12.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.109243 29113 rpc_server.cc:211] RPC server started. Bound to: 127.28.108.62:35143 08:29:12.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.109966 29113 webserver.cc:382] Webserver started at http://127.28.108.62:44469/ using document root and password file 08:29:12.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.110446 29113 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-0/data/info.pb 08:29:12.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.113034 29174 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:12.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.115413 29104 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 29113 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.115948 29104 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/wal 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/data 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.61:46443 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.61 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/logs 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/data/info.pb 08:29:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:12.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.117064 29174 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.127066 29174 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.127913 29174 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.28.108.61:46443: Network error: Client connection negotiation failed: client connection to 127.28.108.61:46443: connect: Connection refused (error 111) 08:29:12.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.147205 29174 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } attempt: 1 08:29:12.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.148408 29174 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.28.108.61:46443: Network error: Client connection negotiation failed: client connection to 127.28.108.61:46443: connect: Connection refused (error 111) 08:29:12.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.172472 29175 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.172686 29175 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.173774 29175 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.173804 29175 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.173812 29175 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:12.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.173820 29175 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:12.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.175575 29175 master_main.cc:98] Master server non-default flags: 08:29:12.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/data 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/wal 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.61:46443 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/data/info.pb 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.61 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.29175 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/logs 08:29:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:12.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:12.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:12.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:12.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:12.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:12.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:12.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.183750 29175 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:12.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.184936 29175 hybrid_clock.cc:181] HybridClock initialized: now 1573720152184893 us; error 42 us; skew 500 ppm 08:29:12.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.185428 29175 fs_manager.cc:261] Metadata directory not provided 08:29:12.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.185482 29175 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:12.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.185686 29175 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:12.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.185714 29175 server_base.cc:453] Attempting to create new FS layout instead 08:29:12.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.187505 29175 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/data/instance: 08:29:12.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c7adb289cbb747b3b8b1128a36f0778a" 08:29:12.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.187775 29175 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/wal/instance: 08:29:12.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c7adb289cbb747b3b8b1128a36f0778a" 08:29:12.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.192469 29175 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s 08:29:12.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.193094 29175 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:12.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.193471 29175 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.196336 29175 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.196426 29175 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/wal 08:29:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c7adb289cbb747b3b8b1128a36f0778a" 08:29:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.196501 29175 fs_report.cc:352] FS layout report 08:29:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/wal 08:29:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/wal 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/data/data 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.196633 29174 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } attempt: 2 08:29:12.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.197779 29174 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.28.108.61:46443: Network error: Client connection negotiation failed: client connection to 127.28.108.61:46443: connect: Connection refused (error 111) 08:29:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.232986 29175 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.238535 29175 rpc_server.cc:211] RPC server started. Bound to: 127.28.108.61:46443 08:29:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.239624 29175 webserver.cc:382] Webserver started at http://127.28.108.61:41129/ using document root and password file 08:29:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.240316 29175 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-1/data/info.pb 08:29:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.241021 29104 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 29175 08:29:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.241492 29104 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/wal 08:29:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/data 08:29:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.60:35317 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.60 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/logs 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/data/info.pb 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.242938 29239 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:12.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.248684 29239 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.259101 29239 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.265888 29239 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.266741 29239 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.28.108.60:35317: Network error: Client connection negotiation failed: client connection to 127.28.108.60:35317: connect: Connection refused (error 111) 08:29:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.285992 29239 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } attempt: 1 08:29:12.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.287055 29239 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.28.108.60:35317: Network error: Client connection negotiation failed: client connection to 127.28.108.60:35317: connect: Connection refused (error 111) 08:29:12.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.305605 29240 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.305814 29240 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.306759 29240 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.306787 29240 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.306793 29240 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.306802 29240 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:12.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.308564 29240 master_main.cc:98] Master server non-default flags: 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/data 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/wal 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.60:35317 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/data/info.pb 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.60 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.29240 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/logs 08:29:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.309022 29174 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } attempt: 3 08:29:12.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.313349 29174 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.314177 29174 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.28.108.60:35317: Network error: Client connection negotiation failed: client connection to 127.28.108.60:35317: connect: Connection refused (error 111) 08:29:12.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.317162 29240 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:12.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.318332 29240 hybrid_clock.cc:181] HybridClock initialized: now 1573720152318274 us; error 52 us; skew 500 ppm 08:29:12.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.318817 29240 fs_manager.cc:261] Metadata directory not provided 08:29:12.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.318863 29240 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:12.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.319064 29240 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:12.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.319092 29240 server_base.cc:453] Attempting to create new FS layout instead 08:29:12.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.320894 29240 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/data/instance: 08:29:12.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5b15c7ceefe74cd59a8198ef596d9a35" 08:29:12.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.321141 29240 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/wal/instance: 08:29:12.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5b15c7ceefe74cd59a8198ef596d9a35" 08:29:12.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.326655 29240 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s 08:29:12.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.327350 29240 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:12.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.327816 29240 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.331297 29240 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.331388 29240 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/wal 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5b15c7ceefe74cd59a8198ef596d9a35" 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.331463 29240 fs_report.cc:352] FS layout report 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/wal 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/wal 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/data/data 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:12.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:12.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:12.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:12.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:12.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:12.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:12.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.335270 29239 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } attempt: 2 08:29:12.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.336319 29239 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.28.108.60:35317: Network error: Client connection negotiation failed: client connection to 127.28.108.60:35317: connect: Connection refused (error 111) 08:29:12.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.353469 29240 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:12.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.359400 29240 rpc_server.cc:211] RPC server started. Bound to: 127.28.108.60:35317 08:29:12.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.360154 29240 webserver.cc:382] Webserver started at http://127.28.108.60:42393/ using document root and password file 08:29:12.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.360648 29240 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/master-2/data/info.pb 08:29:12.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.363791 29303 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:12.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.367509 29303 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.368767 29104 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 29240 08:29:12.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.369547 29104 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:12.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:12.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/wal 08:29:12.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/data 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.1:0 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.28.108.1 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.1 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/logs 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/data/info.pb 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:12.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:12.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:12.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.375833 29303 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.378391 29174 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } attempt: 1 08:29:12.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.379940 29303 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } has no permanent_uuid. Determining permanent_uuid... 08:29:12.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.387853 29303 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35: Bootstrap starting. 08:29:12.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.388403 29174 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d: Bootstrap starting. 08:29:12.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.389772 29303 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35: No blocks or log segments found. Creating new log. 08:29:12.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.390703 29303 log.cc:558] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35: Log is configured to *not* fsync() on all Append() calls 08:29:12.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.390760 29174 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d: No blocks or log segments found. Creating new log. 08:29:12.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.391700 29174 log.cc:558] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d: Log is configured to *not* fsync() on all Append() calls 08:29:12.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.393923 29303 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35: No bootstrap required, opened a new log 08:29:12.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.394443 29174 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d: No bootstrap required, opened a new log 08:29:12.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.396296 29303 raft_consensus.cc:333] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.396380 29303 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:12.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.396430 29303 raft_consensus.cc:698] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b15c7ceefe74cd59a8198ef596d9a35, State: Initialized, Role: FOLLOWER 08:29:12.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.396951 29303 consensus_queue.cc:228] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.397265 29303 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.397301 29303 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.397722 29174 raft_consensus.cc:333] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.397807 29174 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:12.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.397847 29174 raft_consensus.cc:698] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5093330e1f024852adca002d2264c30d, State: Initialized, Role: FOLLOWER 08:29:12.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.398136 29303 sys_catalog.cc:428] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: configured and running, proceeding with master startup. 08:29:12.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.398376 29174 consensus_queue.cc:228] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.398772 29174 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.398813 29174 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.399732 29174 sys_catalog.cc:428] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: configured and running, proceeding with master startup. 08:29:12.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.401101 29310 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.401140 29310 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.403815 29312 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:12.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.403854 29312 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:12.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.404084 29313 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.404103 29313 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.405769 29314 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:12.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.405803 29314 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:12.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.431658 29310 raft_consensus.cc:465] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:12.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.431907 29310 raft_consensus.cc:487] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.433250 29310 leader_election.cc:296] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5093330e1f024852adca002d2264c30d (127.28.108.62:35143), c7adb289cbb747b3b8b1128a36f0778a (127.28.108.61:46443) 08:29:12.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.434214 29151 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5093330e1f024852adca002d2264c30d" is_pre_election: true 08:29:12.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.434494 29151 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b15c7ceefe74cd59a8198ef596d9a35 in term 0. 08:29:12.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.435181 29252 leader_election.cc:310] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5093330e1f024852adca002d2264c30d, 5b15c7ceefe74cd59a8198ef596d9a35; no voters: 08:29:12.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.435564 29310 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:12.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.435608 29310 raft_consensus.cc:465] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:12.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.435636 29310 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 0 FOLLOWER]: Advancing to term 1 08:29:12.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.436992 29310 raft_consensus.cc:487] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.437362 29310 leader_election.cc:296] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [CANDIDATE]: Term 1 election: Requested vote from peers 5093330e1f024852adca002d2264c30d (127.28.108.62:35143), c7adb289cbb747b3b8b1128a36f0778a (127.28.108.61:46443) 08:29:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.437793 29151 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5093330e1f024852adca002d2264c30d" 08:29:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.437847 29151 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [term 0 FOLLOWER]: Advancing to term 1 08:29:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.438951 29151 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b15c7ceefe74cd59a8198ef596d9a35 in term 1. 08:29:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.439263 29252 leader_election.cc:310] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5093330e1f024852adca002d2264c30d, 5b15c7ceefe74cd59a8198ef596d9a35; no voters: 08:29:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.439707 29310 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 1 FOLLOWER]: Leader election won for term 1 08:29:12.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.440228 29310 raft_consensus.cc:660] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [term 1 LEADER]: Becoming Leader. State: Replica: 5b15c7ceefe74cd59a8198ef596d9a35, State: Running, Role: LEADER 08:29:12.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.441151 29310 consensus_queue.cc:205] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.445289 29317 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b15c7ceefe74cd59a8198ef596d9a35. Latest consensus state: current_term: 1 leader_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.445336 29317 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: This master's current role is: LEADER 08:29:12.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.447506 29239 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } attempt: 3 08:29:12.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.450170 29319 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:12.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.451725 29319 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:12.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.456071 29239 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a: Bootstrap starting. 08:29:12.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.458777 29239 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a: No blocks or log segments found. Creating new log. 08:29:12.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.459838 29239 log.cc:558] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a: Log is configured to *not* fsync() on all Append() calls 08:29:12.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.462258 29239 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a: No bootstrap required, opened a new log 08:29:12.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.465695 29239 raft_consensus.cc:333] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.465786 29239 raft_consensus.cc:359] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:12.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.465834 29239 raft_consensus.cc:698] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7adb289cbb747b3b8b1128a36f0778a, State: Initialized, Role: FOLLOWER 08:29:12.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.466432 29239 consensus_queue.cc:228] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } 08:29:12.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.467008 29239 sys_catalog.cc:340] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.467053 29239 sys_catalog.cc:343] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.468089 29239 sys_catalog.cc:428] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: configured and running, proceeding with master startup. 08:29:12.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.468215 29212 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7adb289cbb747b3b8b1128a36f0778a" is_pre_election: true 08:29:12.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.468459 29321 sys_catalog.cc:340] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.468312 29216 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7adb289cbb747b3b8b1128a36f0778a" 08:29:12.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.468840 29212 raft_consensus.cc:2355] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b15c7ceefe74cd59a8198ef596d9a35 in term 0. 08:29:12.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.469444 29216 raft_consensus.cc:2330] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [term 0 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b15c7ceefe74cd59a8198ef596d9a35 for term 1 because replica is already servicing an update from a current leader or another vote. 08:29:12.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.470794 29321 sys_catalog.cc:343] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.473105 29322 catalog_manager.cc:1159] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:12.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.473150 29322 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:12.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.484264 29195 tablet.cc:1764] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:12.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:12.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.505293 29305 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:12.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.505571 29305 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:12.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.506778 29305 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:12.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.506834 29305 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.108.1 08:29:12.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.508572 29305 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:12.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:12.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/data 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/wal 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.1:0 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/data/info.pb 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.1 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.29305 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.28.108.1 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/logs 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:12.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:12.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:12.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:12.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.537267 29305 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:12.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.538468 29305 hybrid_clock.cc:181] HybridClock initialized: now 1573720152538418 us; error 49 us; skew 500 ppm 08:29:12.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.539117 29305 fs_manager.cc:261] Metadata directory not provided 08:29:12.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.539176 29305 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:12.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.539479 29305 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:12.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.539510 29305 server_base.cc:453] Attempting to create new FS layout instead 08:29:12.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.541509 29305 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/data/instance: 08:29:12.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e5c312e761f54e7d8e79f056f888321c" 08:29:12.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.541851 29305 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/wal/instance: 08:29:12.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e5c312e761f54e7d8e79f056f888321c" 08:29:12.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.550329 29305 fs_manager.cc:508] Time spent creating directory manager: real 0.008s user 0.005s sys 0.000s 08:29:12.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.551158 29305 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:12.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.551653 29305 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:12.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.554602 29305 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:12.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.554736 29305 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/wal 08:29:12.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e5c312e761f54e7d8e79f056f888321c" 08:29:12.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.554852 29305 fs_report.cc:352] FS layout report 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/wal 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/wal 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/data/data 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:12.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:12.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:12.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:12.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.570798 29305 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.571990 29305 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.572021 29305 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:12.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.580041 29212 raft_consensus.cc:2901] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [term 0 FOLLOWER]: Advancing to term 1 08:29:12.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.580248 29151 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [term 1 FOLLOWER]: Refusing update from remote peer 5b15c7ceefe74cd59a8198ef596d9a35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:12.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.581197 29317 consensus_queue.cc:981] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:12.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.582062 29212 raft_consensus.cc:1177] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [term 1 FOLLOWER]: Refusing update from remote peer 5b15c7ceefe74cd59a8198ef596d9a35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:12.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.583182 29305 rpc_server.cc:211] RPC server started. Bound to: 127.28.108.1:41543 08:29:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.584175 29305 webserver.cc:382] Webserver started at http://127.28.108.1:38405/ using document root and password file 08:29:12.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.584961 29313 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b15c7ceefe74cd59a8198ef596d9a35. Latest consensus state: current_term: 1 leader_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.584997 29313 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.585186 29317 consensus_queue.cc:981] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:12.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.587116 29305 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-0/data/info.pb 08:29:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.588747 29321 sys_catalog.cc:340] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b15c7ceefe74cd59a8198ef596d9a35. Latest consensus state: current_term: 1 leader_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.589110 29104 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 29305 08:29:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.589771 29104 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/wal 08:29:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/data 08:29:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.2:0 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.28.108.2 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.2 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/logs 08:29:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/data/info.pb 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.590874 29317 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.590903 29317 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: This master's current role is: LEADER 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.591154 29321 sys_catalog.cc:343] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.592021 29313 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.592051 29313 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.594833 29310 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.594864 29310 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35 [sys.catalog]: This master's current role is: LEADER 08:29:12.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.596354 29321 sys_catalog.cc:340] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5093330e1f024852adca002d2264c30d" member_type: VOTER last_known_addr { host: "127.28.108.62" port: 35143 } } peers { permanent_uuid: "c7adb289cbb747b3b8b1128a36f0778a" member_type: VOTER last_known_addr { host: "127.28.108.61" port: 46443 } } peers { permanent_uuid: "5b15c7ceefe74cd59a8198ef596d9a35" member_type: VOTER last_known_addr { host: "127.28.108.60" port: 35317 } } } 08:29:12.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.596380 29321 sys_catalog.cc:343] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a [sys.catalog]: This master's current role is: FOLLOWER 08:29:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.604066 29319 catalog_manager.cc:985] Generated new certificate authority record 08:29:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.604527 29448 heartbeater.cc:322] Connected to a master server at 127.28.108.60:35317 08:29:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.604696 29448 heartbeater.cc:406] Registering TS with master... 08:29:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.605594 29449 heartbeater.cc:322] Connected to a master server at 127.28.108.61:46443 08:29:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.605653 29449 heartbeater.cc:406] Registering TS with master... 08:29:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.605967 29448 heartbeater.cc:455] Master 127.28.108.60:35317 requested a full tablet report, sending... 08:29:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.605980 29449 heartbeater.cc:455] Master 127.28.108.61:46443 requested a full tablet report, sending... 08:29:12.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.607282 29270 ts_manager.cc:191] Registered new tserver with Master: e5c312e761f54e7d8e79f056f888321c (127.28.108.1:41543) 08:29:12.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.607290 29206 ts_manager.cc:191] Registered new tserver with Master: e5c312e761f54e7d8e79f056f888321c (127.28.108.1:41543) 08:29:12.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.607592 29319 catalog_manager.cc:1110] Loading token signing keys... 08:29:12.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.608907 29445 mvcc.cc:203] Tried to move safe_time back from 6445957744959680512 to 6445957744404381696. Current Snapshot: MvccSnapshot[committed={T|T < 6445957744959680512 or (T in {6445957744959680512})}] 08:29:12.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.609484 29451 mvcc.cc:203] Tried to move safe_time back from 6445957744959680512 to 6445957744404381696. Current Snapshot: MvccSnapshot[committed={T|T < 6445957744959680512 or (T in {6445957744959680512})}] 08:29:12.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.609787 29370 mvcc.cc:203] Tried to move safe_time back from 6445957744959680512 to 6445957744404381696. Current Snapshot: MvccSnapshot[committed={T|T < 6445957744959680512 or (T in {6445957744959680512})}] 08:29:12.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.614264 29450 heartbeater.cc:322] Connected to a master server at 127.28.108.62:35143 08:29:12.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.614326 29450 heartbeater.cc:406] Registering TS with master... 08:29:12.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.614508 29450 heartbeater.cc:455] Master 127.28.108.62:35143 requested a full tablet report, sending... 08:29:12.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.615588 29141 ts_manager.cc:191] Registered new tserver with Master: e5c312e761f54e7d8e79f056f888321c (127.28.108.1:41543) 08:29:12.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.636550 29319 catalog_manager.cc:4455] T 00000000000000000000000000000000 P 5b15c7ceefe74cd59a8198ef596d9a35: Generated new TSK 0 08:29:12.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.637401 29319 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:12.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:12.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.686101 29456 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:12.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.686311 29456 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:12.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.687119 29456 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:12.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.687177 29456 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.108.2 08:29:12.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.688755 29456 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/data 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/wal 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.2:0 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/data/info.pb 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.2 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.29456 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.28.108.2 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/logs 08:29:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:12.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:12.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:12.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:12.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:12.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:12.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:12.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.696650 29456 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:12.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.697854 29456 hybrid_clock.cc:181] HybridClock initialized: now 1573720152697806 us; error 45 us; skew 500 ppm 08:29:12.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.698438 29456 fs_manager.cc:261] Metadata directory not provided 08:29:12.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.698488 29456 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:12.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.698698 29456 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:12.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.698724 29456 server_base.cc:453] Attempting to create new FS layout instead 08:29:12.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.700739 29456 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/data/instance: 08:29:12.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "a202a52491994438a38d8ad21f6ceb30" 08:29:12.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.701037 29456 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/wal/instance: 08:29:12.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "a202a52491994438a38d8ad21f6ceb30" 08:29:12.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.706300 29456 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s 08:29:12.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.706970 29456 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:12.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.707383 29456 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:12.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.710450 29456 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:12.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.710813 29456 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/wal 08:29:12.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "a202a52491994438a38d8ad21f6ceb30" 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.710913 29456 fs_report.cc:352] FS layout report 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/wal 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/wal 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/data/data 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:12.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:12.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:12.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.750948 29456 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:12.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.752166 29456 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:12.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.752197 29456 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:12.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.760931 29456 rpc_server.cc:211] RPC server started. Bound to: 127.28.108.2:43133 08:29:12.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.762027 29456 webserver.cc:382] Webserver started at http://127.28.108.2:44893/ using document root and password file 08:29:12.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.762557 29456 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-1/data/info.pb 08:29:12.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.769021 29104 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 29456 08:29:12.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.769649 29104 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:12.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:12.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/wal 08:29:12.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/data 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.3:0 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.28.108.3 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.3 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:12.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/logs 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/data/info.pb 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:12.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.773155 29584 heartbeater.cc:322] Connected to a master server at 127.28.108.61:46443 08:29:12.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.773316 29584 heartbeater.cc:406] Registering TS with master... 08:29:12.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.773753 29584 heartbeater.cc:455] Master 127.28.108.61:46443 requested a full tablet report, sending... 08:29:12.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.774705 29206 ts_manager.cc:191] Registered new tserver with Master: a202a52491994438a38d8ad21f6ceb30 (127.28.108.2:43133) 08:29:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.776182 29585 heartbeater.cc:322] Connected to a master server at 127.28.108.62:35143 08:29:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.776242 29585 heartbeater.cc:406] Registering TS with master... 08:29:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.776393 29585 heartbeater.cc:455] Master 127.28.108.62:35143 requested a full tablet report, sending... 08:29:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.776473 29583 heartbeater.cc:322] Connected to a master server at 127.28.108.60:35317 08:29:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.776546 29583 heartbeater.cc:406] Registering TS with master... 08:29:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.776733 29583 heartbeater.cc:455] Master 127.28.108.60:35317 requested a full tablet report, sending... 08:29:12.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.777142 29141 ts_manager.cc:191] Registered new tserver with Master: a202a52491994438a38d8ad21f6ceb30 (127.28.108.2:43133) 08:29:12.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.777484 29270 ts_manager.cc:191] Registered new tserver with Master: a202a52491994438a38d8ad21f6ceb30 (127.28.108.2:43133) 08:29:12.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.779533 29270 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.28.108.2:33211 08:29:12.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:12.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.822795 29590 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:12.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.823035 29590 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:12.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.823856 29590 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:12.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.823943 29590 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.108.3 08:29:12.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.825670 29590 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.28.108.20:43437 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/data 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/wal 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.28.108.3:0 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:12.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/data/info.pb 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.28.108.3 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.28.108.62:35143,127.28.108.61:46443,127.28.108.60:35317 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.29590 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.28.108.3 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/logs 08:29:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:12.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.834298 29590 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:12.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.835472 29590 hybrid_clock.cc:181] HybridClock initialized: now 1573720152835433 us; error 49 us; skew 500 ppm 08:29:12.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.836021 29590 fs_manager.cc:261] Metadata directory not provided 08:29:12.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.836088 29590 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:12.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.836395 29590 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:12.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.836439 29590 server_base.cc:453] Attempting to create new FS layout instead 08:29:12.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.838380 29590 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/data/instance: 08:29:12.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "dfae21b09a51427eaa171dcef76ca781" 08:29:12.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.838666 29590 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/wal/instance: 08:29:12.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "dfae21b09a51427eaa171dcef76ca781" 08:29:12.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.843945 29590 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s 08:29:12.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.844643 29590 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:12.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.845100 29590 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.848148 29590 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.848253 29590 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/wal 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "dfae21b09a51427eaa171dcef76ca781" 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:12 on dist-test-slave-dist-test-slave-05kx" 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.848330 29590 fs_report.cc:352] FS layout report 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/wal 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/wal 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/data/data 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:12.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:12.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:12.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.883371 29590 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:12.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.884562 29590 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:12.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.884593 29590 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.892514 29590 rpc_server.cc:211] RPC server started. Bound to: 127.28.108.3:42565 08:29:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.893303 29590 webserver.cc:382] Webserver started at http://127.28.108.3:41565/ using document root and password file 08:29:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.893867 29590 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1171356405534613046/ts-2/data/info.pb 08:29:12.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.895220 29104 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 29590 08:29:12.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.905138 29598 connection.cc:664] client connection to 127.28.108.61:46443: finished reading 10 bytes 08:29:12.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.905330 29713 heartbeater.cc:322] Connected to a master server at 127.28.108.61:46443 08:29:12.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.905341 29714 heartbeater.cc:322] Connected to a master server at 127.28.108.62:35143 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.905454 29714 heartbeater.cc:406] Registering TS with master... 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.905457 29713 heartbeater.cc:406] Registering TS with master... 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.905853 29713 heartbeater.cc:455] Master 127.28.108.61:46443 requested a full tablet report, sending... 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.905866 29714 heartbeater.cc:455] Master 127.28.108.62:35143 requested a full tablet report, sending... 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.905341 29712 heartbeater.cc:322] Connected to a master server at 127.28.108.60:35317 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.906245 29712 heartbeater.cc:406] Registering TS with master... 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.906388 29712 heartbeater.cc:455] Master 127.28.108.60:35317 requested a full tablet report, sending... 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.906898 29141 ts_manager.cc:191] Registered new tserver with Master: dfae21b09a51427eaa171dcef76ca781 (127.28.108.3:42565) 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.906898 29206 ts_manager.cc:191] Registered new tserver with Master: dfae21b09a51427eaa171dcef76ca781 (127.28.108.3:42565) 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.906963 29270 ts_manager.cc:191] Registered new tserver with Master: dfae21b09a51427eaa171dcef76ca781 (127.28.108.3:42565) 08:29:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.907907 29270 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.28.108.3:43123 08:29:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.918468 29104 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:12.918 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:12.918 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:12.919 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.28.108.62" port: 35143 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.28.108.61" port: 46443 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.28.108.60" port: 35317 } } } 08:29:12.920 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:12.920 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.28.108.1" port: 41543 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.28.108.2" port: 43133 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.28.108.3" port: 42565 } } } 08:29:12.920 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:12.926 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:12.935 [DEBUG - New I/O worker #28] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.28.108.62 08:29:12.935 [DEBUG - New I/O worker #30] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.28.108.61 08:29:12.937 [DEBUG - New I/O worker #29] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.28.108.60 08:29:12.946 [DEBUG - New I/O worker #28] (Negotiator.java:764) Authenticated connection [id: 0x7c564290, /127.0.0.1:52608 => /127.28.108.62:35143] using SASL/PLAIN 08:29:12.946 [DEBUG - New I/O worker #29] (Negotiator.java:764) Authenticated connection [id: 0xb9ddd9e9, /127.0.0.1:51430 => /127.28.108.60:35317] using SASL/PLAIN 08:29:12.950 [DEBUG - New I/O worker #30] (Negotiator.java:764) Authenticated connection [id: 0x0dc3b2cb, /127.0.0.1:52896 => /127.28.108.61:46443] using SASL/PLAIN 08:29:12.951 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:12.951 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=25), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.108.62:35143, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.108.60:35317, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.108.61:46443, [23ms] Sub RPC ConnectToMaster: received response from server master-127.28.108.62:35143: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.28.108.60:35317: OK, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.108.61:46443: OK, deferred=null) after lookup 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.955504 29270 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51430: 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:12.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:12.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:12.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:12.956495 29270 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:12.967 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:777) Opened table 894d0de698774b6ab79a1c617f0ce95a 08:29:12.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.978394 29648 tablet_service.cc:1023] Processing CreateTablet for tablet c56150af551c4357b02205d6c04e338b (table=org.apache.kudu.client.TestAsyncKuduSession [id=894d0de698774b6ab79a1c617f0ce95a]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:12.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.978394 29382 tablet_service.cc:1023] Processing CreateTablet for tablet c56150af551c4357b02205d6c04e338b (table=org.apache.kudu.client.TestAsyncKuduSession [id=894d0de698774b6ab79a1c617f0ce95a]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:12.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.978417 29519 tablet_service.cc:1023] Processing CreateTablet for tablet c56150af551c4357b02205d6c04e338b (table=org.apache.kudu.client.TestAsyncKuduSession [id=894d0de698774b6ab79a1c617f0ce95a]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:12.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.978976 29519 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet c56150af551c4357b02205d6c04e338b. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:12.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.978976 29648 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet c56150af551c4357b02205d6c04e338b. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:12.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.978976 29382 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet c56150af551c4357b02205d6c04e338b. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:12.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.985091 29738 tablet_bootstrap.cc:439] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781: Bootstrap starting. 08:29:12.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.986726 29738 tablet_bootstrap.cc:590] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781: No blocks or log segments found. Creating new log. 08:29:12.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.987386 29738 log.cc:558] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781: Log is configured to *not* fsync() on all Append() calls 08:29:12.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.987915 29739 tablet_bootstrap.cc:439] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c: Bootstrap starting. 08:29:12.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.989109 29737 tablet_bootstrap.cc:439] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30: Bootstrap starting. 08:29:12.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.990514 29737 tablet_bootstrap.cc:590] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30: No blocks or log segments found. Creating new log. 08:29:12.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.991233 29737 log.cc:558] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30: Log is configured to *not* fsync() on all Append() calls 08:29:12.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.992023 29739 tablet_bootstrap.cc:590] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c: No blocks or log segments found. Creating new log. 08:29:12.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.992530 29739 log.cc:558] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c: Log is configured to *not* fsync() on all Append() calls 08:29:12.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.993974 29739 tablet_bootstrap.cc:439] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c: No bootstrap required, opened a new log 08:29:12.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.994022 29737 tablet_bootstrap.cc:439] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30: No bootstrap required, opened a new log 08:29:12.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.994189 29737 ts_tablet_manager.cc:1096] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s 08:29:12.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.994208 29739 ts_tablet_manager.cc:1096] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s 08:29:12.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.994515 29738 tablet_bootstrap.cc:439] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781: No bootstrap required, opened a new log 08:29:12.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.994688 29738 ts_tablet_manager.cc:1096] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s 08:29:12.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.996661 29737 raft_consensus.cc:333] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:12.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.996743 29737 raft_consensus.cc:359] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:12.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.996832 29737 raft_consensus.cc:698] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a202a52491994438a38d8ad21f6ceb30, State: Initialized, Role: FOLLOWER 08:29:12.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.997303 29737 consensus_queue.cc:228] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:12.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.997463 29738 raft_consensus.cc:333] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:12.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.997463 29739 raft_consensus.cc:333] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:12.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.997560 29739 raft_consensus.cc:359] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:12.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.997617 29739 raft_consensus.cc:698] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c312e761f54e7d8e79f056f888321c, State: Initialized, Role: FOLLOWER 08:29:12.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.997848 29583 heartbeater.cc:447] Master 127.28.108.60:35317 was elected leader, sending a full tablet report... 08:29:12.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.998112 29739 consensus_queue.cc:228] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:12.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.998159 29738 raft_consensus.cc:359] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:12.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.998198 29738 raft_consensus.cc:698] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfae21b09a51427eaa171dcef76ca781, State: Initialized, Role: FOLLOWER 08:29:12.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.998417 29737 ts_tablet_manager.cc:1124] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30: Time spent starting tablet: real 0.004s user 0.001s sys 0.004s 08:29:12.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.998586 29738 consensus_queue.cc:228] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:12.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:12.999043 29712 heartbeater.cc:447] Master 127.28.108.60:35317 was elected leader, sending a full tablet report... 08:29:13.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.001915 29738 ts_tablet_manager.cc:1124] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s 08:29:13.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.002156 29269 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.28.108.1:39091 08:29:13.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.003428 29739 ts_tablet_manager.cc:1124] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c: Time spent starting tablet: real 0.009s user 0.004s sys 0.001s 08:29:13.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.004114 29448 heartbeater.cc:447] Master 127.28.108.60:35317 was elected leader, sending a full tablet report... 08:29:13.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.014336 29586 tablet.cc:1764] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:13.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.096421 29452 tablet.cc:1764] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:13.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.148510 29715 tablet.cc:1764] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:13.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.345896 29744 raft_consensus.cc:465] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:13.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.346086 29744 raft_consensus.cc:487] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:13.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.347208 29744 leader_election.cc:296] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a202a52491994438a38d8ad21f6ceb30 (127.28.108.2:43133), e5c312e761f54e7d8e79f056f888321c (127.28.108.1:41543) 08:29:13.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.348546 29743 raft_consensus.cc:465] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:13.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.348709 29743 raft_consensus.cc:487] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:13.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.349602 29743 leader_election.cc:296] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfae21b09a51427eaa171dcef76ca781 (127.28.108.3:42565), e5c312e761f54e7d8e79f056f888321c (127.28.108.1:41543) 08:29:13.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.352344 29532 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "c56150af551c4357b02205d6c04e338b" candidate_uuid: "dfae21b09a51427eaa171dcef76ca781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a202a52491994438a38d8ad21f6ceb30" is_pre_election: true 08:29:13.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.352461 29532 raft_consensus.cc:2355] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfae21b09a51427eaa171dcef76ca781 in term 0. 08:29:13.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.353327 29400 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "c56150af551c4357b02205d6c04e338b" candidate_uuid: "dfae21b09a51427eaa171dcef76ca781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c312e761f54e7d8e79f056f888321c" is_pre_election: true 08:29:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.353340 29601 leader_election.cc:310] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a202a52491994438a38d8ad21f6ceb30, dfae21b09a51427eaa171dcef76ca781; no voters: 08:29:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.353538 29400 raft_consensus.cc:2355] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfae21b09a51427eaa171dcef76ca781 in term 0. 08:29:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.353634 29744 raft_consensus.cc:2649] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.353679 29744 raft_consensus.cc:465] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.353708 29744 raft_consensus.cc:2901] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 0 FOLLOWER]: Advancing to term 1 08:29:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.354748 29663 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "c56150af551c4357b02205d6c04e338b" candidate_uuid: "a202a52491994438a38d8ad21f6ceb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfae21b09a51427eaa171dcef76ca781" is_pre_election: true 08:29:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.354907 29744 raft_consensus.cc:487] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:13.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.355074 29663 raft_consensus.cc:2285] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a202a52491994438a38d8ad21f6ceb30 in current term 1: Already voted for candidate dfae21b09a51427eaa171dcef76ca781 in this term. 08:29:13.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.355250 29744 leader_election.cc:296] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [CANDIDATE]: Term 1 election: Requested vote from peers a202a52491994438a38d8ad21f6ceb30 (127.28.108.2:43133), e5c312e761f54e7d8e79f056f888321c (127.28.108.1:41543) 08:29:13.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.355695 29532 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "c56150af551c4357b02205d6c04e338b" candidate_uuid: "dfae21b09a51427eaa171dcef76ca781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a202a52491994438a38d8ad21f6ceb30" 08:29:13.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.355721 29400 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "c56150af551c4357b02205d6c04e338b" candidate_uuid: "dfae21b09a51427eaa171dcef76ca781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c312e761f54e7d8e79f056f888321c" 08:29:13.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.355767 29532 raft_consensus.cc:2901] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 0 FOLLOWER]: Advancing to term 1 08:29:13.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.355805 29400 raft_consensus.cc:2901] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c [term 0 FOLLOWER]: Advancing to term 1 08:29:13.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.356716 29532 raft_consensus.cc:2355] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfae21b09a51427eaa171dcef76ca781 in term 1. 08:29:13.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.357065 29400 raft_consensus.cc:2355] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfae21b09a51427eaa171dcef76ca781 in term 1. 08:29:13.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.357234 29601 leader_election.cc:310] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a202a52491994438a38d8ad21f6ceb30, dfae21b09a51427eaa171dcef76ca781; no voters: 08:29:13.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.357252 29399 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "c56150af551c4357b02205d6c04e338b" candidate_uuid: "a202a52491994438a38d8ad21f6ceb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c312e761f54e7d8e79f056f888321c" is_pre_election: true 08:29:13.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.357334 29399 raft_consensus.cc:2285] T c56150af551c4357b02205d6c04e338b P e5c312e761f54e7d8e79f056f888321c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a202a52491994438a38d8ad21f6ceb30 in current term 1: Already voted for candidate dfae21b09a51427eaa171dcef76ca781 in this term. 08:29:13.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.357764 29744 raft_consensus.cc:2649] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 1 FOLLOWER]: Leader election won for term 1 08:29:13.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.357848 29469 leader_election.cc:310] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a202a52491994438a38d8ad21f6ceb30; no voters: dfae21b09a51427eaa171dcef76ca781, e5c312e761f54e7d8e79f056f888321c 08:29:13.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.357955 29744 raft_consensus.cc:660] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [term 1 LEADER]: Becoming Leader. State: Replica: dfae21b09a51427eaa171dcef76ca781, State: Running, Role: LEADER 08:29:13.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.358258 29743 raft_consensus.cc:2597] T c56150af551c4357b02205d6c04e338b P a202a52491994438a38d8ad21f6ceb30 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority 08:29:13.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.358899 29744 consensus_queue.cc:205] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } } 08:29:13.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.363024 29268 catalog_manager.cc:4143] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 reported cstate change: term changed from 0 to 1, leader changed from to dfae21b09a51427eaa171dcef76ca781 (127.28.108.3). New cstate: current_term: 1 leader_uuid: "dfae21b09a51427eaa171dcef76ca781" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfae21b09a51427eaa171dcef76ca781" member_type: VOTER last_known_addr { host: "127.28.108.3" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 } health_report { overall_health: UNKNOWN } } } 08:29:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.409778 29314 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d: acquiring CA information for follower catalog manager: success 08:29:13.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.411373 29314 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 5093330e1f024852adca002d2264c30d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:13.413 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.413 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.415 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.416 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.416 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.417 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.418 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.418 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.419 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.419 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.419 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.419 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.420 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.421 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.421 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.421 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.422 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.422 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.422 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:1313) Retrying sending RPC ScanRequest(scannerId=null, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=9), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.108.60:35317, [9ms] Sub RPC GetTableLocations: received response from server master-127.28.108.60:35317: OK, deferred=null)) after lookup 08:29:13.423 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.424 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.424 [DEBUG - New I/O worker #29] (AsyncKuduClient.java:2346) Learned about tablet c56150af551c4357b02205d6c04e338b for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:13.425 [DEBUG - New I/O worker #29] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=c56150af551c4357b02205d6c04e338b@[a202a52491994438a38d8ad21f6ceb30(127.28.108.2:43133),dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)[L],e5c312e761f54e7d8e79f056f888321c(127.28.108.1:41543)]}] 08:29:13.435 [DEBUG - New I/O worker #31] (Negotiator.java:764) Authenticated connection [id: 0x54b61e74, /127.0.0.1:39296 => /127.28.108.3:42565] using TOKEN/null 08:29:13.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.437463 29628 tablet_service.cc:2373] Rejecting scan request for tablet c56150af551c4357b02205d6c04e338b: Uninitialized: safe time has not yet been initialized 08:29:13.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.450532 29628 tablet_service.cc:2373] Rejecting scan request for tablet c56150af551c4357b02205d6c04e338b: Uninitialized: safe time has not yet been initialized 08:29:13.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.470235 29628 tablet_service.cc:2373] Rejecting scan request for tablet c56150af551c4357b02205d6c04e338b: Uninitialized: safe time has not yet been initialized 08:29:13.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.476480 29322 catalog_manager.cc:1157] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a: acquiring CA information for follower catalog manager: success 08:29:13.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.477684 29322 catalog_manager.cc:1185] T 00000000000000000000000000000000 P c7adb289cbb747b3b8b1128a36f0778a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:13.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.489711 29628 tablet_service.cc:2373] Rejecting scan request for tablet c56150af551c4357b02205d6c04e338b: Uninitialized: safe time has not yet been initialized 08:29:13.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.529562 29628 tablet_service.cc:2373] Rejecting scan request for tablet c56150af551c4357b02205d6c04e338b: Uninitialized: safe time has not yet been initialized 08:29:13.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.549208 29628 tablet_service.cc:2373] Rejecting scan request for tablet c56150af551c4357b02205d6c04e338b: Uninitialized: safe time has not yet been initialized 08:29:13.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:13.649461 29628 tablet_service.cc:2373] Rejecting scan request for tablet c56150af551c4357b02205d6c04e338b: Uninitialized: safe time has not yet been initialized 08:29:13.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.809937 29744 consensus_queue.cc:981] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a202a52491994438a38d8ad21f6ceb30" member_type: VOTER last_known_addr { host: "127.28.108.2" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:13.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.817744 29755 consensus_queue.cc:981] T c56150af551c4357b02205d6c04e338b P dfae21b09a51427eaa171dcef76ca781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5c312e761f54e7d8e79f056f888321c" member_type: VOTER last_known_addr { host: "127.28.108.1" port: 41543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:13.892 [DEBUG - New I/O worker #31] (AsyncKuduScanner.java:1141) AsyncKuduScanner$Response(scannerId = "", data = RowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestAsyncKuduSession, tablet=c56150af551c4357b02205d6c04e338b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=, endPrimaryKey=) 08:29:13.892 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=10, flusherTask=null, flushNotification=Deferred@1925502345(state=PENDING, result=null, callback=, errback=)} 08:29:13.912 [DEBUG - New I/O worker #31] (AsyncKuduScanner.java:1141) AsyncKuduScanner$Response(scannerId = "", data = RowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestAsyncKuduSession, tablet=c56150af551c4357b02205d6c04e338b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=, endPrimaryKey=) 08:29:13.913 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2068897588(state=PENDING, result=null, callback=, errback=)} 08:29:13.923 [DEBUG - New I/O worker #29] (Connection.java:691) [peer master-127.28.108.60:35317(127.28.108.60:35317)] cleaning up while in state READY due to: connection disconnected 08:29:13.925 [DEBUG - New I/O worker #30] (Connection.java:691) [peer master-127.28.108.61:46443(127.28.108.61:46443)] cleaning up while in state READY due to: connection disconnected 08:29:13.925 [DEBUG - New I/O worker #31] (Connection.java:691) [peer dfae21b09a51427eaa171dcef76ca781(127.28.108.3:42565)] cleaning up while in state READY due to: connection disconnected 08:29:13.927 [DEBUG - New I/O worker #28] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:13.928 [DEBUG - New I/O worker #28] (Connection.java:691) [peer master-127.28.108.62:35143(127.28.108.62:35143)] cleaning up while in state READY due to: connection disconnected 08:29:13.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.929630 29104 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 29305 08:29:13.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.935570 29104 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 29456 08:29:13.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.942863 29104 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 29590 08:29:13.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.947104 29104 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 29113 08:29:13.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.950572 29104 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 29175 08:29:13.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:13.954247 29104 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 29240 08:29:13.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:13Z chronyd exiting 08:29:13.978 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720153978 08:29:13.981 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:13.981 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:13.981 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:13.982 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:13.982 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:13.983 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207" hms_mode: NONE mini_kdc_options { } } 08:29:14.055 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:14.055 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:14.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:14.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:14Z Disabled control of system clock 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.071893 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/wal 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/data 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.190:44763 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.190 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/logs 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/data/info.pb 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:14.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:14.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.126904 29775 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:14.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.127118 29775 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:14.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.128357 29775 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:14.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.128397 29775 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:14.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.128410 29775 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:14.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.128424 29775 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:14.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.130548 29775 master_main.cc:98] Master server non-default flags: 08:29:14.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/data 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/wal 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.190:44763 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/data/info.pb 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.190 08:29:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.29775 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/logs 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:14.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:14.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:14.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:14.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.138151 29775 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:14.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.139322 29775 hybrid_clock.cc:181] HybridClock initialized: now 1573720154139278 us; error 47 us; skew 500 ppm 08:29:14.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.139850 29775 fs_manager.cc:261] Metadata directory not provided 08:29:14.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.139901 29775 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:14.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.140178 29775 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:14.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.140208 29775 server_base.cc:453] Attempting to create new FS layout instead 08:29:14.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.142055 29775 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/data/instance: 08:29:14.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "9daed12fee2941818a97b2d05e1ef5d9" 08:29:14.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.142376 29775 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/wal/instance: 08:29:14.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "9daed12fee2941818a97b2d05e1ef5d9" 08:29:14.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.147683 29775 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s 08:29:14.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.148486 29775 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:14.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.149032 29775 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.152220 29775 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.152315 29775 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/wal 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "9daed12fee2941818a97b2d05e1ef5d9" 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.152400 29775 fs_report.cc:352] FS layout report 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/wal 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/wal 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/data/data 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:14.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:14.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:14.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:14.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.168849 29775 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:14.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.174883 29775 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.190:44763 08:29:14.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.175859 29775 webserver.cc:382] Webserver started at http://127.29.17.190:33329/ using document root and password file 08:29:14.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.176424 29775 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-0/data/info.pb 08:29:14.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.179033 29837 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.182399 29837 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.186856 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 29775 08:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.187317 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/wal 08:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/data 08:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.189:43723 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.189 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/logs 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/data/info.pb 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:14.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.192879 29837 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.193779 29837 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.29.17.189:43723: Network error: Client connection negotiation failed: client connection to 127.29.17.189:43723: connect: Connection refused (error 111) 08:29:14.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.213006 29837 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } attempt: 1 08:29:14.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.214198 29837 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.29.17.189:43723: Network error: Client connection negotiation failed: client connection to 127.29.17.189:43723: connect: Connection refused (error 111) 08:29:14.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:14.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.251729 29840 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:14.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.251973 29840 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:14.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.252964 29840 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:14.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.252998 29840 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:14.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.253008 29840 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:14.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.253021 29840 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.255128 29840 master_main.cc:98] Master server non-default flags: 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/data 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/wal 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.189:43723 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/data/info.pb 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.189 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.29840 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/logs 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:14.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.262390 29837 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } attempt: 2 08:29:14.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.263242 29837 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.29.17.189:43723: Network error: Client connection negotiation failed: client connection to 127.29.17.189:43723: connect: Connection refused (error 111) 08:29:14.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.264634 29840 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:14.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.265833 29840 hybrid_clock.cc:181] HybridClock initialized: now 1573720154265775 us; error 58 us; skew 500 ppm 08:29:14.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.266428 29840 fs_manager.cc:261] Metadata directory not provided 08:29:14.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.266485 29840 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:14.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.266765 29840 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:14.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.266808 29840 server_base.cc:453] Attempting to create new FS layout instead 08:29:14.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.269088 29840 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/data/instance: 08:29:14.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" 08:29:14.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.269340 29840 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/wal/instance: 08:29:14.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" 08:29:14.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.274693 29840 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s 08:29:14.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.275310 29840 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:14.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.275705 29840 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.278985 29840 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.279078 29840 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/wal 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.279158 29840 fs_report.cc:352] FS layout report 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/wal 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/wal 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/data/data 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.341843 29840 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:14.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.347985 29840 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.189:43723 08:29:14.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.348901 29840 webserver.cc:382] Webserver started at http://127.29.17.189:45929/ using document root and password file 08:29:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.349499 29840 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-1/data/info.pb 08:29:14.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.352267 29901 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:14.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.353355 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 29840 08:29:14.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.353796 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:14.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/wal 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/data 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.188:43575 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.188 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/logs 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/data/info.pb 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.355841 29901 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.365073 29901 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.370470 29901 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.371105 29901 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.29.17.188:43575: Network error: Client connection negotiation failed: client connection to 127.29.17.188:43575: connect: Connection refused (error 111) 08:29:14.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.374418 29837 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } attempt: 3 08:29:14.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.378211 29837 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.378813 29837 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.29.17.188:43575: Network error: Client connection negotiation failed: client connection to 127.29.17.188:43575: connect: Connection refused (error 111) 08:29:14.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.390336 29901 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } attempt: 1 08:29:14.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.391167 29901 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.29.17.188:43575: Network error: Client connection negotiation failed: client connection to 127.29.17.188:43575: connect: Connection refused (error 111) 08:29:14.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:14.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.415511 29902 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:14.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.415740 29902 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:14.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.416873 29902 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:14.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.416908 29902 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:14.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.416920 29902 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:14.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.416934 29902 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.418874 29902 master_main.cc:98] Master server non-default flags: 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/data 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/wal 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.188:43575 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/data/info.pb 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.188 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.29902 08:29:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/logs 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:14.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.425830 29902 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:14.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.427042 29902 hybrid_clock.cc:181] HybridClock initialized: now 1573720154426997 us; error 41 us; skew 500 ppm 08:29:14.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.427533 29902 fs_manager.cc:261] Metadata directory not provided 08:29:14.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.427587 29902 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:14.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.427791 29902 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:14.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.427820 29902 server_base.cc:453] Attempting to create new FS layout instead 08:29:14.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.429617 29902 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/data/instance: 08:29:14.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" 08:29:14.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.429863 29902 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/wal/instance: 08:29:14.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" 08:29:14.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.434653 29902 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s 08:29:14.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.435214 29902 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:14.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.435575 29902 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.438447 29902 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.438530 29902 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/wal 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.438603 29902 fs_report.cc:352] FS layout report 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/wal 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/wal 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/data/data 08:29:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.439353 29901 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } attempt: 2 08:29:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.440310 29901 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.29.17.188:43575: Network error: Client connection negotiation failed: client connection to 127.29.17.188:43575: connect: Connection refused (error 111) 08:29:14.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.443006 29837 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } attempt: 1 08:29:14.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.443775 29837 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.29.17.188:43575: Network error: Client connection negotiation failed: client connection to 127.29.17.188:43575: connect: Connection refused (error 111) 08:29:14.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.466563 29902 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:14.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.472200 29902 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.188:43575 08:29:14.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.473206 29902 webserver.cc:382] Webserver started at http://127.29.17.188:42427/ using document root and password file 08:29:14.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.473819 29902 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/master-2/data/info.pb 08:29:14.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.476430 29966 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:14.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.479892 29966 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.481590 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 29902 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.482236 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.129:0 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.129 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.129 08:29:14.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/logs 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/info.pb 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:14.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.489007 29966 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.493160 29966 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } has no permanent_uuid. Determining permanent_uuid... 08:29:14.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.501642 29966 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1: Bootstrap starting. 08:29:14.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.503996 29966 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1: No blocks or log segments found. Creating new log. 08:29:14.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.504994 29966 log.cc:558] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1: Log is configured to *not* fsync() on all Append() calls 08:29:14.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.506440 29966 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1: No bootstrap required, opened a new log 08:29:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.509018 29966 raft_consensus.cc:333] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.509114 29966 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.509166 29966 raft_consensus.cc:698] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6fb1ecd45b45f1a3b76039d7a21eb1, State: Initialized, Role: FOLLOWER 08:29:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.509652 29966 consensus_queue.cc:228] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.510001 29966 sys_catalog.cc:340] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.510046 29966 sys_catalog.cc:343] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.510876 29966 sys_catalog.cc:428] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: configured and running, proceeding with master startup. 08:29:14.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.511286 29971 sys_catalog.cc:340] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.511749 29971 sys_catalog.cc:343] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.514308 29972 catalog_manager.cc:1159] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:14.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.514354 29972 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:14.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.523012 29837 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } attempt: 2 08:29:14.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.531369 29837 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9: Bootstrap starting. 08:29:14.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:14.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.534067 29968 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:14.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.534283 29968 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:14.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.534472 29837 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9: No blocks or log segments found. Creating new log. 08:29:14.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.535280 29968 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:14.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.535368 29968 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.17.129 08:29:14.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.535606 29837 log.cc:558] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9: Log is configured to *not* fsync() on all Append() calls 08:29:14.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.537413 29968 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:14.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.129:0 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/info.pb 08:29:14.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.129 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.29968 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.129 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/logs 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.537655 29837 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9: No bootstrap required, opened a new log 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.541059 29837 raft_consensus.cc:333] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.541136 29837 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.541180 29837 raft_consensus.cc:698] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9daed12fee2941818a97b2d05e1ef5d9, State: Initialized, Role: FOLLOWER 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.541683 29837 consensus_queue.cc:228] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.542076 29837 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.542107 29837 sys_catalog.cc:343] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.543103 29837 sys_catalog.cc:428] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: configured and running, proceeding with master startup. 08:29:14.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.545063 29978 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.545114 29978 sys_catalog.cc:343] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.548009 29979 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:14.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.548063 29979 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:14.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.549008 29968 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:14.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.551481 29901 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } attempt: 3 08:29:14.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.556457 29968 hybrid_clock.cc:181] HybridClock initialized: now 1573720154556373 us; error 78 us; skew 500 ppm 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.557210 29901 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe: Bootstrap starting. 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.557494 29968 fs_manager.cc:261] Metadata directory not provided 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.557546 29968 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.557839 29968 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.557876 29968 server_base.cc:453] Attempting to create new FS layout instead 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.559587 29901 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe: No blocks or log segments found. Creating new log. 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.560207 29968 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/instance: 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "36efc1a3b89247c4b8eee0c35f8df5db" 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.560524 29968 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal/instance: 08:29:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "36efc1a3b89247c4b8eee0c35f8df5db" 08:29:14.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.560681 29901 log.cc:558] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe: Log is configured to *not* fsync() on all Append() calls 08:29:14.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.566011 29901 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe: No bootstrap required, opened a new log 08:29:14.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.567080 29968 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s 08:29:14.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.567881 29968 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:14.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.568369 29968 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:14.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.569897 29901 raft_consensus.cc:333] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.569989 29901 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:14.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.570031 29901 raft_consensus.cc:698] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dbbfb4989b442eaa85e5989a05b6cbe, State: Initialized, Role: FOLLOWER 08:29:14.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.570904 29901 consensus_queue.cc:228] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.571267 29901 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.571298 29901 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.572096 29968 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:14.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.572203 29968 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:14.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "36efc1a3b89247c4b8eee0c35f8df5db" 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.572223 29901 sys_catalog.cc:428] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: configured and running, proceeding with master startup. 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.572315 29968 fs_report.cc:352] FS layout report 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/data 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:14.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:14.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:14.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:14.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:14.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:14.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.573256 29986 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.573303 29986 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.585345 29987 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:14.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.585414 29987 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:14.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.593252 29857 tablet.cc:1764] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:14.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.595852 29968 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:14.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.597095 29968 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:14.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.597128 29968 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:14.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.603552 29968 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.129:44623 08:29:14.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.604389 29968 webserver.cc:382] Webserver started at http://127.29.17.129:37955/ using document root and password file 08:29:14.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.604918 29968 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/info.pb 08:29:14.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.607708 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 29968 08:29:14.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.608294 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:14.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:14.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:14.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data 08:29:14.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.130:0 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.130 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.130 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/logs 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/info.pb 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:14.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.612365 29971 raft_consensus.cc:465] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.612550 29971 raft_consensus.cc:487] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.613672 29971 leader_election.cc:296] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9daed12fee2941818a97b2d05e1ef5d9 (127.29.17.190:44763), 5dbbfb4989b442eaa85e5989a05b6cbe (127.29.17.189:43723) 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.614524 29873 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" is_pre_election: true 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.614742 29873 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd6fb1ecd45b45f1a3b76039d7a21eb1 in term 0. 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.615281 29913 leader_election.cc:310] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dbbfb4989b442eaa85e5989a05b6cbe, cd6fb1ecd45b45f1a3b76039d7a21eb1; no voters: 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.616151 29813 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9daed12fee2941818a97b2d05e1ef5d9" is_pre_election: true 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.616353 29813 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd6fb1ecd45b45f1a3b76039d7a21eb1 in term 0. 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.616755 29971 raft_consensus.cc:2649] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.617087 29971 raft_consensus.cc:465] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.617123 29971 raft_consensus.cc:2901] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 0 FOLLOWER]: Advancing to term 1 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.618280 29971 raft_consensus.cc:487] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.618611 29971 leader_election.cc:296] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [CANDIDATE]: Term 1 election: Requested vote from peers 9daed12fee2941818a97b2d05e1ef5d9 (127.29.17.190:44763), 5dbbfb4989b442eaa85e5989a05b6cbe (127.29.17.189:43723) 08:29:14.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.619040 29873 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" 08:29:14.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.619097 29873 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [term 0 FOLLOWER]: Advancing to term 1 08:29:14.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.620061 29873 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd6fb1ecd45b45f1a3b76039d7a21eb1 in term 1. 08:29:14.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.620380 29913 leader_election.cc:310] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dbbfb4989b442eaa85e5989a05b6cbe, cd6fb1ecd45b45f1a3b76039d7a21eb1; no voters: 08:29:14.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.620887 29813 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9daed12fee2941818a97b2d05e1ef5d9" 08:29:14.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.620954 29813 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [term 0 FOLLOWER]: Advancing to term 1 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.622004 29813 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd6fb1ecd45b45f1a3b76039d7a21eb1 in term 1. 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.622438 29971 raft_consensus.cc:2649] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 1 FOLLOWER]: Leader election won for term 1 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.622664 29971 raft_consensus.cc:660] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [term 1 LEADER]: Becoming Leader. State: Replica: cd6fb1ecd45b45f1a3b76039d7a21eb1, State: Running, Role: LEADER 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.623071 29971 consensus_queue.cc:205] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.624413 30103 heartbeater.cc:322] Connected to a master server at 127.29.17.188:43575 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.624591 30103 heartbeater.cc:406] Registering TS with master... 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.624904 30111 sys_catalog.cc:340] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd6fb1ecd45b45f1a3b76039d7a21eb1. Latest consensus state: current_term: 1 leader_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.624929 30111 sys_catalog.cc:343] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: This master's current role is: LEADER 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.625134 30103 heartbeater.cc:455] Master 127.29.17.188:43575 requested a full tablet report, sending... 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.626592 29926 ts_manager.cc:191] Registered new tserver with Master: 36efc1a3b89247c4b8eee0c35f8df5db (127.29.17.129:44623) 08:29:14.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.627336 30113 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:14.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.630636 30104 heartbeater.cc:322] Connected to a master server at 127.29.17.189:43723 08:29:14.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.630692 30104 heartbeater.cc:406] Registering TS with master... 08:29:14.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.630847 30104 heartbeater.cc:455] Master 127.29.17.189:43723 requested a full tablet report, sending... 08:29:14.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.631875 29868 ts_manager.cc:191] Registered new tserver with Master: 36efc1a3b89247c4b8eee0c35f8df5db (127.29.17.129:44623) 08:29:14.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.632918 30105 heartbeater.cc:322] Connected to a master server at 127.29.17.190:44763 08:29:14.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.632962 30105 heartbeater.cc:406] Registering TS with master... 08:29:14.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.633100 30105 heartbeater.cc:455] Master 127.29.17.190:44763 requested a full tablet report, sending... 08:29:14.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.634191 30113 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:14.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.634299 29802 ts_manager.cc:191] Registered new tserver with Master: 36efc1a3b89247c4b8eee0c35f8df5db (127.29.17.129:44623) 08:29:14.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:14.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.669975 30109 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:14.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.670181 30109 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:14.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.671172 30109 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:14.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.671257 30109 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.17.130 08:29:14.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.672345 29792 tablet.cc:1764] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.673116 30109 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.130:0 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/info.pb 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.130 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.30109 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.130 08:29:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/logs 08:29:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:14.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.681020 30109 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:14.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.689488 29813 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [term 1 FOLLOWER]: Refusing update from remote peer cd6fb1ecd45b45f1a3b76039d7a21eb1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:14.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.689501 29873 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [term 1 FOLLOWER]: Refusing update from remote peer cd6fb1ecd45b45f1a3b76039d7a21eb1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:14.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.690307 30111 consensus_queue.cc:981] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:14.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.690611 30111 consensus_queue.cc:981] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:14.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.694548 29978 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd6fb1ecd45b45f1a3b76039d7a21eb1. Latest consensus state: current_term: 1 leader_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.694548 29986 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd6fb1ecd45b45f1a3b76039d7a21eb1. Latest consensus state: current_term: 1 leader_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.694573 29986 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.694573 29978 sys_catalog.cc:343] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.695219 30109 hybrid_clock.cc:181] HybridClock initialized: now 1573720154695141 us; error 80 us; skew 500 ppm 08:29:14.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.695909 30109 fs_manager.cc:261] Metadata directory not provided 08:29:14.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.695960 30109 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:14.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.696226 30109 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:14.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.696252 30109 server_base.cc:453] Attempting to create new FS layout instead 08:29:14.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.698415 30109 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/instance: 08:29:14.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "2c79e45a52a14032908ca1f212f8fde7" 08:29:14.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.698736 30109 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal/instance: 08:29:14.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "2c79e45a52a14032908ca1f212f8fde7" 08:29:14.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.704267 29971 sys_catalog.cc:340] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.704301 29971 sys_catalog.cc:343] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: This master's current role is: LEADER 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.704423 29971 sys_catalog.cc:340] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.704439 29971 sys_catalog.cc:343] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1 [sys.catalog]: This master's current role is: LEADER 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.705785 29978 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.705822 29978 sys_catalog.cc:343] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.705916 29986 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9daed12fee2941818a97b2d05e1ef5d9" member_type: VOTER last_known_addr { host: "127.29.17.190" port: 44763 } } peers { permanent_uuid: "5dbbfb4989b442eaa85e5989a05b6cbe" member_type: VOTER last_known_addr { host: "127.29.17.189" port: 43723 } } peers { permanent_uuid: "cd6fb1ecd45b45f1a3b76039d7a21eb1" member_type: VOTER last_known_addr { host: "127.29.17.188" port: 43575 } } } 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.705942 29986 sys_catalog.cc:343] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe [sys.catalog]: This master's current role is: FOLLOWER 08:29:14.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.706596 30121 mvcc.cc:203] Tried to move safe_time back from 6445957753596485632 to 6445957753338642432. Current Snapshot: MvccSnapshot[committed={T|T < 6445957753596485632}] 08:29:14.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.707073 30117 mvcc.cc:203] Tried to move safe_time back from 6445957753596485632 to 6445957753338642432. Current Snapshot: MvccSnapshot[committed={T|T < 6445957753596485632}] 08:29:14.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.711371 30122 mvcc.cc:203] Tried to move safe_time back from 6445957753596485632 to 6445957753338642432. Current Snapshot: MvccSnapshot[committed={T|T < 6445957753596485632 or (T in {6445957753596485632})}] 08:29:14.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.711779 30113 catalog_manager.cc:985] Generated new certificate authority record 08:29:14.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.711781 30109 fs_manager.cc:508] Time spent creating directory manager: real 0.013s user 0.003s sys 0.003s 08:29:14.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.712743 30109 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:14.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.713171 30113 catalog_manager.cc:1110] Loading token signing keys... 08:29:14.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.713362 30109 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:14.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.717386 30109 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:14.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.718720 30109 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:14.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "2c79e45a52a14032908ca1f212f8fde7" 08:29:14.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.719149 30109 fs_report.cc:352] FS layout report 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/data 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:14.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:14.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:14.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:14.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.728441 30113 catalog_manager.cc:4455] T 00000000000000000000000000000000 P cd6fb1ecd45b45f1a3b76039d7a21eb1: Generated new TSK 0 08:29:14.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.728971 30113 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:14.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.795099 30109 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:14.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.796700 30109 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:14.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.796742 30109 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:14.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.806639 30109 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.130:33231 08:29:14.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.807711 30109 webserver.cc:382] Webserver started at http://127.29.17.130:41041/ using document root and password file 08:29:14.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.808367 30109 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/info.pb 08:29:14.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.808655 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 30109 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.809264 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.131:0 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.131 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.131 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/logs 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/info.pb 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:14.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:14.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.820894 30245 heartbeater.cc:322] Connected to a master server at 127.29.17.189:43723 08:29:14.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.821321 30245 heartbeater.cc:406] Registering TS with master... 08:29:14.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.821669 30244 heartbeater.cc:322] Connected to a master server at 127.29.17.188:43575 08:29:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.821683 30246 heartbeater.cc:322] Connected to a master server at 127.29.17.190:44763 08:29:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.822063 30244 heartbeater.cc:406] Registering TS with master... 08:29:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.822091 30246 heartbeater.cc:406] Registering TS with master... 08:29:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.822268 30246 heartbeater.cc:455] Master 127.29.17.190:44763 requested a full tablet report, sending... 08:29:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.822294 30244 heartbeater.cc:455] Master 127.29.17.188:43575 requested a full tablet report, sending... 08:29:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.821903 30245 heartbeater.cc:455] Master 127.29.17.189:43723 requested a full tablet report, sending... 08:29:14.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.823340 29926 ts_manager.cc:191] Registered new tserver with Master: 2c79e45a52a14032908ca1f212f8fde7 (127.29.17.130:33231) 08:29:14.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.823345 29802 ts_manager.cc:191] Registered new tserver with Master: 2c79e45a52a14032908ca1f212f8fde7 (127.29.17.130:33231) 08:29:14.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.823348 29868 ts_manager.cc:191] Registered new tserver with Master: 2c79e45a52a14032908ca1f212f8fde7 (127.29.17.130:33231) 08:29:14.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.825676 29926 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.29.17.130:50471 08:29:14.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:14.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.898043 30248 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:14.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.898272 30248 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:14.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.899092 30248 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:14.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:14.899152 30248 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.17.131 08:29:14.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.900817 30248 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.131:0 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/info.pb 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.131 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.30248 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.131 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/logs 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:14.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.908458 30248 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:14.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.909669 30248 hybrid_clock.cc:181] HybridClock initialized: now 1573720154909634 us; error 41 us; skew 500 ppm 08:29:14.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.910169 30248 fs_manager.cc:261] Metadata directory not provided 08:29:14.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.910212 30248 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:14.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.910419 30248 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:14.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.910444 30248 server_base.cc:453] Attempting to create new FS layout instead 08:29:14.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.912290 30248 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/instance: 08:29:14.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c42be8da4e7c41b2b590d87b4d029360" 08:29:14.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.912542 30248 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal/instance: 08:29:14.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c42be8da4e7c41b2b590d87b4d029360" 08:29:14.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.917373 30248 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s 08:29:14.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.917951 30248 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:14.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.918326 30248 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.921110 30248 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.921205 30248 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c42be8da4e7c41b2b590d87b4d029360" 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.921280 30248 fs_report.cc:352] FS layout report 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/data 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:14.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.952101 30248 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:14.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.953332 30248 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:14.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.953364 30248 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:14.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.961932 30248 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.131:45411 08:29:14.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.962790 30248 webserver.cc:382] Webserver started at http://127.29.17.131:35877/ using document root and password file 08:29:14.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.963276 30248 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/info.pb 08:29:14.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.970768 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 30248 08:29:14.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.972532 30374 heartbeater.cc:322] Connected to a master server at 127.29.17.189:43723 08:29:14.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.972620 30373 heartbeater.cc:322] Connected to a master server at 127.29.17.188:43575 08:29:14.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.972683 30373 heartbeater.cc:406] Registering TS with master... 08:29:14.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.972685 30374 heartbeater.cc:406] Registering TS with master... 08:29:14.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.973120 30375 heartbeater.cc:322] Connected to a master server at 127.29.17.190:44763 08:29:14.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.973166 30375 heartbeater.cc:406] Registering TS with master... 08:29:14.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.973228 30374 heartbeater.cc:455] Master 127.29.17.189:43723 requested a full tablet report, sending... 08:29:14.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.973275 30375 heartbeater.cc:455] Master 127.29.17.190:44763 requested a full tablet report, sending... 08:29:14.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.973654 30373 heartbeater.cc:455] Master 127.29.17.188:43575 requested a full tablet report, sending... 08:29:14.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.974268 29926 ts_manager.cc:191] Registered new tserver with Master: c42be8da4e7c41b2b590d87b4d029360 (127.29.17.131:45411) 08:29:14.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.974311 29802 ts_manager.cc:191] Registered new tserver with Master: c42be8da4e7c41b2b590d87b4d029360 (127.29.17.131:45411) 08:29:14.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.974740 29868 ts_manager.cc:191] Registered new tserver with Master: c42be8da4e7c41b2b590d87b4d029360 (127.29.17.131:45411) 08:29:14.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.975214 29926 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.29.17.131:43999 08:29:14.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:14.990141 29766 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:14.990 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:14.990 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:14.991 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.29.17.190" port: 44763 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.29.17.189" port: 43723 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.29.17.188" port: 43575 } } } 08:29:14.991 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:14.992 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.29.17.129" port: 44623 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.29.17.130" port: 33231 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.29.17.131" port: 45411 } } } 08:29:14.992 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:14.998 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:15.003 [DEBUG - New I/O worker #37] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.29.17.189 08:29:15.005 [DEBUG - New I/O worker #38] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.29.17.188 08:29:15.009 [DEBUG - New I/O worker #39] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.29.17.190 08:29:15.012 [DEBUG - New I/O worker #37] (Negotiator.java:764) Authenticated connection [id: 0x8bb350d2, /127.0.0.1:37336 => /127.29.17.189:43723] using SASL/PLAIN 08:29:15.020 [DEBUG - New I/O worker #38] (Negotiator.java:764) Authenticated connection [id: 0x2a5b6c9c, /127.0.0.1:39628 => /127.29.17.188:43575] using SASL/PLAIN 08:29:15.023 [DEBUG - New I/O worker #38] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:15.023 [DEBUG - New I/O worker #38] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=25), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.17.189:43723, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.17.188:43575, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.17.190:44763, [19ms] Sub RPC ConnectToMaster: received response from server master-127.29.17.189:43723: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.29.17.188:43575: OK, deferred=null) after lookup 08:29:15.027 [DEBUG - New I/O worker #39] (Negotiator.java:764) Authenticated connection [id: 0xbcad13ab, /127.0.0.1:39664 => /127.29.17.190:44763] using SASL/PLAIN 08:29:15.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.029227 29926 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39628: 08:29:15.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:15.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:15.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:15.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:15.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.030180 29926 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:15.043 [DEBUG - New I/O worker #38] (AsyncKuduClient.java:777) Opened table 2765a34d979943e2acf3310d4f1397ae 08:29:15.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.054877 30039 tablet_service.cc:1023] Processing CreateTablet for tablet 18971b825f5c4351b660bc2361d74795 (table=org.apache.kudu.client.TestAsyncKuduSession [id=2765a34d979943e2acf3310d4f1397ae]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:15.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.054873 30177 tablet_service.cc:1023] Processing CreateTablet for tablet 18971b825f5c4351b660bc2361d74795 (table=org.apache.kudu.client.TestAsyncKuduSession [id=2765a34d979943e2acf3310d4f1397ae]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:15.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.055371 30309 tablet_service.cc:1023] Processing CreateTablet for tablet 18971b825f5c4351b660bc2361d74795 (table=org.apache.kudu.client.TestAsyncKuduSession [id=2765a34d979943e2acf3310d4f1397ae]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:15.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.055495 30177 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 18971b825f5c4351b660bc2361d74795. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:15.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.055496 30039 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 18971b825f5c4351b660bc2361d74795. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:15.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.055909 30309 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 18971b825f5c4351b660bc2361d74795. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:15.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.062122 30397 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Bootstrap starting. 08:29:15.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.064141 30397 tablet_bootstrap.cc:590] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: No blocks or log segments found. Creating new log. 08:29:15.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.065053 30398 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Bootstrap starting. 08:29:15.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.066234 30398 tablet_bootstrap.cc:590] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: No blocks or log segments found. Creating new log. 08:29:15.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.066768 30398 log.cc:558] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Log is configured to *not* fsync() on all Append() calls 08:29:15.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.067493 30399 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Bootstrap starting. 08:29:15.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.067939 30397 log.cc:558] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Log is configured to *not* fsync() on all Append() calls 08:29:15.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.068559 30398 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: No bootstrap required, opened a new log 08:29:15.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.068819 30398 ts_tablet_manager.cc:1096] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s 08:29:15.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.069185 30399 tablet_bootstrap.cc:590] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: No blocks or log segments found. Creating new log. 08:29:15.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.069725 30397 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: No bootstrap required, opened a new log 08:29:15.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.069772 30399 log.cc:558] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Log is configured to *not* fsync() on all Append() calls 08:29:15.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.069878 30397 ts_tablet_manager.cc:1096] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s 08:29:15.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.070842 30399 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: No bootstrap required, opened a new log 08:29:15.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.071012 30399 ts_tablet_manager.cc:1096] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s 08:29:15.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.071902 30398 raft_consensus.cc:333] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.072160 30398 raft_consensus.cc:359] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:15.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.072351 30398 raft_consensus.cc:698] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c79e45a52a14032908ca1f212f8fde7, State: Initialized, Role: FOLLOWER 08:29:15.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.072521 30397 raft_consensus.cc:333] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.072618 30397 raft_consensus.cc:359] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:15.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.072659 30397 raft_consensus.cc:698] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c42be8da4e7c41b2b590d87b4d029360, State: Initialized, Role: FOLLOWER 08:29:15.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.073012 30398 consensus_queue.cc:228] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.073110 30397 consensus_queue.cc:228] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.073487 30244 heartbeater.cc:447] Master 127.29.17.188:43575 was elected leader, sending a full tablet report... 08:29:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.073487 30373 heartbeater.cc:447] Master 127.29.17.188:43575 was elected leader, sending a full tablet report... 08:29:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.073637 30399 raft_consensus.cc:333] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.073712 30399 raft_consensus.cc:359] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.073748 30399 raft_consensus.cc:698] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36efc1a3b89247c4b8eee0c35f8df5db, State: Initialized, Role: FOLLOWER 08:29:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.074213 30399 consensus_queue.cc:228] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.076586 30397 ts_tablet_manager.cc:1124] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Time spent starting tablet: real 0.007s user 0.000s sys 0.004s 08:29:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.077106 29928 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.29.17.129:56885 08:29:15.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.078889 30103 heartbeater.cc:447] Master 127.29.17.188:43575 was elected leader, sending a full tablet report... 08:29:15.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.081133 30399 ts_tablet_manager.cc:1124] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Time spent starting tablet: real 0.010s user 0.002s sys 0.002s 08:29:15.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.082554 30398 ts_tablet_manager.cc:1124] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s 08:29:15.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.110355 30106 tablet.cc:1764] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:15.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.214953 30376 tablet.cc:1764] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.303814 30405 raft_consensus.cc:465] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.304047 30405 raft_consensus.cc:487] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.305299 30405 leader_election.cc:296] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c42be8da4e7c41b2b590d87b4d029360 (127.29.17.131:45411), 2c79e45a52a14032908ca1f212f8fde7 (127.29.17.130:33231) 08:29:15.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.309980 30329 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "18971b825f5c4351b660bc2361d74795" candidate_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c42be8da4e7c41b2b590d87b4d029360" is_pre_election: true 08:29:15.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.309998 30187 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "18971b825f5c4351b660bc2361d74795" candidate_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c79e45a52a14032908ca1f212f8fde7" is_pre_election: true 08:29:15.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.310145 30187 raft_consensus.cc:2355] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36efc1a3b89247c4b8eee0c35f8df5db in term 0. 08:29:15.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.310184 30329 raft_consensus.cc:2355] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36efc1a3b89247c4b8eee0c35f8df5db in term 0. 08:29:15.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.310638 29991 leader_election.cc:310] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2c79e45a52a14032908ca1f212f8fde7, 36efc1a3b89247c4b8eee0c35f8df5db, c42be8da4e7c41b2b590d87b4d029360; no voters: 08:29:15.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.310969 30405 raft_consensus.cc:2649] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:15.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.311025 30405 raft_consensus.cc:465] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:15.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.311053 30405 raft_consensus.cc:2901] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Advancing to term 1 08:29:15.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.311972 30405 raft_consensus.cc:487] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.312129 30247 tablet.cc:1764] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:15.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.312384 30405 leader_election.cc:296] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [CANDIDATE]: Term 1 election: Requested vote from peers c42be8da4e7c41b2b590d87b4d029360 (127.29.17.131:45411), 2c79e45a52a14032908ca1f212f8fde7 (127.29.17.130:33231) 08:29:15.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.312762 30329 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "18971b825f5c4351b660bc2361d74795" candidate_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c42be8da4e7c41b2b590d87b4d029360" 08:29:15.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.312855 30187 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "18971b825f5c4351b660bc2361d74795" candidate_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c79e45a52a14032908ca1f212f8fde7" 08:29:15.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.312866 30329 raft_consensus.cc:2901] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [term 0 FOLLOWER]: Advancing to term 1 08:29:15.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.312898 30187 raft_consensus.cc:2901] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [term 0 FOLLOWER]: Advancing to term 1 08:29:15.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.313696 30329 raft_consensus.cc:2355] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36efc1a3b89247c4b8eee0c35f8df5db in term 1. 08:29:15.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.314036 29989 leader_election.cc:310] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36efc1a3b89247c4b8eee0c35f8df5db, c42be8da4e7c41b2b590d87b4d029360; no voters: 08:29:15.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.314043 30187 raft_consensus.cc:2355] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36efc1a3b89247c4b8eee0c35f8df5db in term 1. 08:29:15.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.314203 30405 raft_consensus.cc:2649] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Leader election won for term 1 08:29:15.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.314355 30405 raft_consensus.cc:660] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 LEADER]: Becoming Leader. State: Replica: 36efc1a3b89247c4b8eee0c35f8df5db, State: Running, Role: LEADER 08:29:15.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.314637 30405 consensus_queue.cc:205] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.317646 29928 catalog_manager.cc:4143] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db reported cstate change: term changed from 0 to 1, leader changed from to 36efc1a3b89247c4b8eee0c35f8df5db (127.29.17.129). New cstate: current_term: 1 leader_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } health_report { overall_health: HEALTHY } } } 08:29:15.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.443888 29928 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39628: 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "non-replicated" 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) num_replicas: 1 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:15.452 [DEBUG - New I/O worker #38] (AsyncKuduClient.java:777) Opened table e208172189064af9a8590c3e39ddef53 08:29:15.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.454912 30039 tablet_service.cc:1023] Processing CreateTablet for tablet f9cb94ff74d549c09f337c97e79eb02c (table=non-replicated [id=e208172189064af9a8590c3e39ddef53]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:15.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.455276 30039 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet f9cb94ff74d549c09f337c97e79eb02c. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:15.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.457343 30399 tablet_bootstrap.cc:439] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: Bootstrap starting. 08:29:15.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.458422 30399 tablet_bootstrap.cc:590] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: No blocks or log segments found. Creating new log. 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.459688 30399 tablet_bootstrap.cc:439] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: No bootstrap required, opened a new log 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.459794 30399 ts_tablet_manager.cc:1096] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.460448 30399 raft_consensus.cc:333] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.460474 30399 raft_consensus.cc:359] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.460492 30399 raft_consensus.cc:698] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36efc1a3b89247c4b8eee0c35f8df5db, State: Initialized, Role: FOLLOWER 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.460669 30399 consensus_queue.cc:228] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.460703 30399 raft_consensus.cc:373] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.460721 30399 raft_consensus.cc:465] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.460747 30399 raft_consensus.cc:2901] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 0 FOLLOWER]: Advancing to term 1 08:29:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.461735 30399 raft_consensus.cc:487] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.461843 30399 leader_election.cc:310] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36efc1a3b89247c4b8eee0c35f8df5db; no voters: 08:29:15.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.461943 30399 leader_election.cc:296] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [CANDIDATE]: Term 1 election: Requested vote from peers 08:29:15.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.462071 30405 raft_consensus.cc:2649] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Leader election won for term 1 08:29:15.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.462234 30405 raft_consensus.cc:660] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 LEADER]: Becoming Leader. State: Replica: 36efc1a3b89247c4b8eee0c35f8df5db, State: Running, Role: LEADER 08:29:15.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.462370 30405 consensus_queue.cc:205] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.463619 30399 ts_tablet_manager.cc:1124] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s 08:29:15.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.464586 29928 catalog_manager.cc:4143] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db reported cstate change: term changed from 0 to 1, leader changed from to 36efc1a3b89247c4b8eee0c35f8df5db (127.29.17.129). New cstate: current_term: 1 leader_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } health_report { overall_health: HEALTHY } } } 08:29:15.483 [DEBUG - New I/O worker #38] (AsyncKuduClient.java:2346) Learned about tablet f9cb94ff74d549c09f337c97e79eb02c for table 'non-replicated' with partition [, ) 08:29:15.484 [DEBUG - New I/O worker #38] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f9cb94ff74d549c09f337c97e79eb02c@[36efc1a3b89247c4b8eee0c35f8df5db(127.29.17.129:44623)[L]]}] 08:29:15.484 [DEBUG - New I/O worker #38] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.29.17.188:43575, [2ms] Sub RPC GetTableLocations: received response from server master-127.29.17.188:43575: OK, deferred=null) after lookup 08:29:15.496 [DEBUG - New I/O worker #40] (Negotiator.java:764) Authenticated connection [id: 0x09bbac09, /127.0.0.1:54830 => /127.29.17.129:44623] using TOKEN/null 08:29:15.504 [INFO - Time-limited test] (MiniKuduCluster.java:368) Killing tablet server 127.29.17.130:33231 08:29:15.505 [DEBUG - Time-limited test] (MiniKuduCluster.java:155) Request: stop_daemon { id { type: TSERVER index: 1 } } 08:29:15.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.506176 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 30109 08:29:15.510 [DEBUG - Time-limited test] (MiniKuduCluster.java:165) Response: 08:29:15.510 [INFO - Time-limited test] (MiniKuduCluster.java:368) Killing tablet server 127.29.17.129:44623 08:29:15.510 [DEBUG - Time-limited test] (MiniKuduCluster.java:155) Request: stop_daemon { id { type: TSERVER index: 0 } } 08:29:15.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.511134 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 29968 08:29:15.515 [DEBUG - Time-limited test] (MiniKuduCluster.java:165) Response: 08:29:15.516 [DEBUG - New I/O worker #40] (Connection.java:691) [peer 36efc1a3b89247c4b8eee0c35f8df5db(127.29.17.129:44623)] cleaning up while in state READY due to: connection disconnected 08:29:15.516 [INFO - Time-limited test] (MiniKuduCluster.java:368) Killing tablet server 127.29.17.131:45411 08:29:15.516 [DEBUG - Time-limited test] (MiniKuduCluster.java:155) Request: stop_daemon { id { type: TSERVER index: 2 } } 08:29:15.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.516696 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 30248 08:29:15.520 [DEBUG - Time-limited test] (MiniKuduCluster.java:165) Response: 08:29:15.520 [INFO - Time-limited test] (MiniKuduCluster.java:349) Starting tablet server 127.29.17.130:33231 08:29:15.521 [DEBUG - Time-limited test] (MiniKuduCluster.java:155) Request: start_daemon { id { type: TSERVER index: 1 } } 08:29:15.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.522593 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:15.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:15.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:15.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data 08:29:15.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.130:33231 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.130 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=41041 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.130 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/logs 08:29:15.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/info.pb 08:29:15.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:15.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:15.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:15.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:15.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:15.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:15.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:15.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.551396 29979 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9: acquiring CA information for follower catalog manager: success 08:29:15.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.552505 29979 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 9daed12fee2941818a97b2d05e1ef5d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:15.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:15.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.569644 30417 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:15.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.569834 30417 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:15.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.570657 30417 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:15.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.570714 30417 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.17.130 08:29:15.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.572261 30417 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:15.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:15.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:15.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:15.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.130:33231 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/info.pb 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.130 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=41041 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:15.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.30417 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.130 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/logs 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:15.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:15.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:15.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.580330 30417 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:15.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.581513 30417 hybrid_clock.cc:181] HybridClock initialized: now 1573720155581470 us; error 43 us; skew 500 ppm 08:29:15.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.581941 30417 fs_manager.cc:261] Metadata directory not provided 08:29:15.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.581996 30417 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:15.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.585623 30417 fs_manager.cc:404] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s 08:29:15.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.585997 30417 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:15.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.586381 30417 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:15.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.589231 29987 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe: acquiring CA information for follower catalog manager: success 08:29:15.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.589565 30417 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.590128 30417 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "2c79e45a52a14032908ca1f212f8fde7" 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.590255 30417 fs_report.cc:352] FS layout report 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/wal 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/data 08:29:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.590351 29987 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 5dbbfb4989b442eaa85e5989a05b6cbe: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:15.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.605312 30417 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:15.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.606457 30417 ts_tablet_manager.cc:376] Loading tablet metadata (0/1 complete) 08:29:15.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.608686 30417 ts_tablet_manager.cc:388] Loaded tablet metadata (1 total tablets, 1 live tablets) 08:29:15.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.608719 30417 ts_tablet_manager.cc:394] Registering tablets (0/1 complete) 08:29:15.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.609894 30417 ts_tablet_manager.cc:408] Registered 1 tablets 08:29:15.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.610237 30434 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Bootstrap starting. 08:29:15.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.620529 30417 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.130:33231 08:29:15.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.622200 30417 webserver.cc:382] Webserver started at http://127.29.17.130:41041/ using document root and password file 08:29:15.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.622918 30417 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-1/data/info.pb 08:29:15.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.624384 30434 log.cc:558] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Log is configured to *not* fsync() on all Append() calls 08:29:15.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.626739 30434 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 08:29:15.627 [DEBUG - Time-limited test] (MiniKuduCluster.java:165) Response: 08:29:15.627 [INFO - Time-limited test] (MiniKuduCluster.java:349) Starting tablet server 127.29.17.129:44623 08:29:15.627 [DEBUG - Time-limited test] (MiniKuduCluster.java:155) Request: start_daemon { id { type: TSERVER index: 0 } } 08:29:15.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.627138 30434 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Bootstrap complete. 08:29:15.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.627171 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 30417 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.628170 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.129:44623 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.129 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=37955 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.129 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/logs 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/info.pb 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:15.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:15.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.628315 30434 ts_tablet_manager.cc:1096] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.000s 08:29:15.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.631985 30434 raft_consensus.cc:333] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.632088 30434 raft_consensus.cc:698] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c79e45a52a14032908ca1f212f8fde7, State: Initialized, Role: FOLLOWER 08:29:15.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.632567 30434 consensus_queue.cc:228] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.633450 30434 ts_tablet_manager.cc:1124] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s 08:29:15.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.635274 30540 heartbeater.cc:322] Connected to a master server at 127.29.17.188:43575 08:29:15.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.635445 30540 heartbeater.cc:406] Registering TS with master... 08:29:15.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.635958 30540 heartbeater.cc:455] Master 127.29.17.188:43575 requested a full tablet report, sending... 08:29:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.635275 30541 heartbeater.cc:322] Connected to a master server at 127.29.17.189:43723 08:29:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.636843 30541 heartbeater.cc:406] Registering TS with master... 08:29:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.636970 30541 heartbeater.cc:455] Master 127.29.17.189:43723 requested a full tablet report, sending... 08:29:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.637651 29932 ts_manager.cc:191] Re-registered known tserver with Master: 2c79e45a52a14032908ca1f212f8fde7 (127.29.17.130:33231) 08:29:15.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.638675 29932 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.29.17.130:42053 08:29:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.639358 30542 heartbeater.cc:322] Connected to a master server at 127.29.17.190:44763 08:29:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.639413 30542 heartbeater.cc:406] Registering TS with master... 08:29:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.639539 30542 heartbeater.cc:455] Master 127.29.17.190:44763 requested a full tablet report, sending... 08:29:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.639706 29868 ts_manager.cc:191] Re-registered known tserver with Master: 2c79e45a52a14032908ca1f212f8fde7 (127.29.17.130:33231) 08:29:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.640504 29802 ts_manager.cc:191] Re-registered known tserver with Master: 2c79e45a52a14032908ca1f212f8fde7 (127.29.17.130:33231) 08:29:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.640689 30540 heartbeater.cc:447] Master 127.29.17.188:43575 was elected leader, sending a full tablet report... 08:29:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.678068 30551 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.678280 30551 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.679239 30551 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.679332 30551 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.17.129 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.680948 30551 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.129:44623 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/info.pb 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.129 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=37955 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.30551 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.129 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/logs 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.687885 30551 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:15.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.689057 30551 hybrid_clock.cc:181] HybridClock initialized: now 1573720155689020 us; error 38 us; skew 500 ppm 08:29:15.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.689499 30551 fs_manager.cc:261] Metadata directory not provided 08:29:15.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.689553 30551 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:15.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.692880 30551 fs_manager.cc:404] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s 08:29:15.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.693265 30551 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:15.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.693608 30551 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.696172 30551 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.696676 30551 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "36efc1a3b89247c4b8eee0c35f8df5db" 08:29:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.696768 30551 fs_report.cc:352] FS layout report 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/wal 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/data 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:15.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.727892 30551 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:15.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.729009 30551 ts_tablet_manager.cc:376] Loading tablet metadata (0/2 complete) 08:29:15.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.731659 30551 ts_tablet_manager.cc:388] Loaded tablet metadata (2 total tablets, 2 live tablets) 08:29:15.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.731691 30551 ts_tablet_manager.cc:394] Registering tablets (0/2 complete) 08:29:15.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.733276 30551 ts_tablet_manager.cc:408] Registered 2 tablets 08:29:15.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.733381 30569 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Bootstrap starting. 08:29:15.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.741839 30551 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.129:44623 08:29:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.742693 30551 webserver.cc:382] Webserver started at http://127.29.17.129:37955/ using document root and password file 08:29:15.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.743237 30551 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-0/data/info.pb 08:29:15.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.744907 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 30551 08:29:15.745 [DEBUG - Time-limited test] (MiniKuduCluster.java:165) Response: 08:29:15.745 [INFO - Time-limited test] (MiniKuduCluster.java:349) Starting tablet server 127.29.17.131:45411 08:29:15.745 [DEBUG - Time-limited test] (MiniKuduCluster.java:155) Request: start_daemon { id { type: TSERVER index: 2 } } 08:29:15.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.746111 29766 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.131:45411 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.131 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=35877 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.131 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/logs 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/info.pb 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:15.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:15.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:15.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:15.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:15.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:15.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:15.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.748147 30569 log.cc:558] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Log is configured to *not* fsync() on all Append() calls 08:29:15.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.752959 30569 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates 08:29:15.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.753338 30569 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Bootstrap complete. 08:29:15.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.754233 30569 ts_tablet_manager.cc:1096] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.000s 08:29:15.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.756249 30676 heartbeater.cc:322] Connected to a master server at 127.29.17.189:43723 08:29:15.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.756395 30676 heartbeater.cc:406] Registering TS with master... 08:29:15.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.756897 30676 heartbeater.cc:455] Master 127.29.17.189:43723 requested a full tablet report, sending... 08:29:15.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.758289 30569 raft_consensus.cc:333] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Replica starting. Triggering 1 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.759644 30569 raft_consensus.cc:698] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36efc1a3b89247c4b8eee0c35f8df5db, State: Initialized, Role: FOLLOWER 08:29:15.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.759999 30675 heartbeater.cc:322] Connected to a master server at 127.29.17.188:43575 08:29:15.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.760098 30675 heartbeater.cc:406] Registering TS with master... 08:29:15.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.760288 30675 heartbeater.cc:455] Master 127.29.17.188:43575 requested a full tablet report, sending... 08:29:15.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.760387 30569 consensus_queue.cc:228] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.761538 30677 heartbeater.cc:322] Connected to a master server at 127.29.17.190:44763 08:29:15.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.761593 30677 heartbeater.cc:406] Registering TS with master... 08:29:15.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.761725 30677 heartbeater.cc:455] Master 127.29.17.190:44763 requested a full tablet report, sending... 08:29:15.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.761955 29932 ts_manager.cc:191] Re-registered known tserver with Master: 36efc1a3b89247c4b8eee0c35f8df5db (127.29.17.129:44623) 08:29:15.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.762637 29802 ts_manager.cc:191] Re-registered known tserver with Master: 36efc1a3b89247c4b8eee0c35f8df5db (127.29.17.129:44623) 08:29:15.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.763070 29868 ts_manager.cc:191] Re-registered known tserver with Master: 36efc1a3b89247c4b8eee0c35f8df5db (127.29.17.129:44623) 08:29:15.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.763442 29932 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.29.17.129:33501 08:29:15.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.765053 30569 ts_tablet_manager.cc:1124] T 18971b825f5c4351b660bc2361d74795 P 36efc1a3b89247c4b8eee0c35f8df5db: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s 08:29:15.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.765321 30569 tablet_bootstrap.cc:439] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: Bootstrap starting. 08:29:15.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.765713 30675 heartbeater.cc:447] Master 127.29.17.188:43575 was elected leader, sending a full tablet report... 08:29:15.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.779538 30569 tablet_bootstrap.cc:439] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 08:29:15.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.779863 30569 tablet_bootstrap.cc:439] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: Bootstrap complete. 08:29:15.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.780591 30569 ts_tablet_manager.cc:1096] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.008s 08:29:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.781219 30569 raft_consensus.cc:333] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.781260 30569 raft_consensus.cc:698] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36efc1a3b89247c4b8eee0c35f8df5db, State: Initialized, Role: FOLLOWER 08:29:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.781486 30569 consensus_queue.cc:228] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.781535 30569 raft_consensus.cc:373] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately 08:29:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.781579 30569 raft_consensus.cc:465] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) 08:29:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.781652 30569 raft_consensus.cc:2901] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 1 FOLLOWER]: Advancing to term 2 08:29:15.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.783128 30569 raft_consensus.cc:487] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.783468 30569 leader_election.cc:310] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36efc1a3b89247c4b8eee0c35f8df5db; no voters: 08:29:15.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.783681 30569 leader_election.cc:296] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [CANDIDATE]: Term 2 election: Requested vote from peers 08:29:15.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.783895 30684 raft_consensus.cc:2649] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 2 FOLLOWER]: Leader election won for term 2 08:29:15.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.784083 30684 raft_consensus.cc:660] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [term 2 LEADER]: Becoming Leader. State: Replica: 36efc1a3b89247c4b8eee0c35f8df5db, State: Running, Role: LEADER 08:29:15.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.784332 30684 consensus_queue.cc:205] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.784687 30569 ts_tablet_manager.cc:1124] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s 08:29:15.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.787079 29932 catalog_manager.cc:4143] T f9cb94ff74d549c09f337c97e79eb02c P 36efc1a3b89247c4b8eee0c35f8df5db reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } health_report { overall_health: HEALTHY } } } 08:29:15.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:15.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.805002 30682 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:15.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.805222 30682 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:15.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.806233 30682 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:15.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.806318 30682 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.17.131 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.807950 30682 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.29.17.148:33143 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.29.17.131:45411 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:15.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/info.pb 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.29.17.131 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=35877 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.29.17.190:44763,127.29.17.189:43723,127.29.17.188:43575 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.30682 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.29.17.131 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/logs 08:29:15.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:15.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:15.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:15.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:15.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:15.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:15.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:15.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:15.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.815841 30682 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:15.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.817025 30682 hybrid_clock.cc:181] HybridClock initialized: now 1573720155816996 us; error 21 us; skew 500 ppm 08:29:15.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.817471 30682 fs_manager.cc:261] Metadata directory not provided 08:29:15.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.817536 30682 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:15.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.821322 30682 fs_manager.cc:404] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s 08:29:15.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.821702 30682 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:15.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.822074 30682 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.825143 30682 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.825685 30682 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "c42be8da4e7c41b2b590d87b4d029360" 08:29:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:14 on dist-test-slave-dist-test-slave-05kx" 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.825788 30682 fs_report.cc:352] FS layout report 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/wal 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/data 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:15.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.855937 30682 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:15.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.857363 30682 ts_tablet_manager.cc:376] Loading tablet metadata (0/1 complete) 08:29:15.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.859539 30682 ts_tablet_manager.cc:388] Loaded tablet metadata (1 total tablets, 1 live tablets) 08:29:15.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.859570 30682 ts_tablet_manager.cc:394] Registering tablets (0/1 complete) 08:29:15.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.860615 30682 ts_tablet_manager.cc:408] Registered 1 tablets 08:29:15.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.861057 30706 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Bootstrap starting. 08:29:15.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.873986 30682 rpc_server.cc:211] RPC server started. Bound to: 127.29.17.131:45411 08:29:15.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.874997 30682 webserver.cc:382] Webserver started at http://127.29.17.131:35877/ using document root and password file 08:29:15.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.875638 30706 log.cc:558] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Log is configured to *not* fsync() on all Append() calls 08:29:15.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.875694 30682 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster5737929435402678207/ts-2/data/info.pb 08:29:15.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:15.875880 30543 tablet.cc:1764] T 18971b825f5c4351b660bc2361d74795 P 2c79e45a52a14032908ca1f212f8fde7: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:15.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.877110 30706 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 08:29:15.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.877418 30706 tablet_bootstrap.cc:439] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Bootstrap complete. 08:29:15.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.878281 30706 ts_tablet_manager.cc:1096] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.004s 08:29:15.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.883149 30706 raft_consensus.cc:333] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.883251 30706 raft_consensus.cc:698] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c42be8da4e7c41b2b590d87b4d029360, State: Initialized, Role: FOLLOWER 08:29:15.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.883729 30706 consensus_queue.cc:228] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c42be8da4e7c41b2b590d87b4d029360" member_type: VOTER last_known_addr { host: "127.29.17.131" port: 45411 } } peers { permanent_uuid: "2c79e45a52a14032908ca1f212f8fde7" member_type: VOTER last_known_addr { host: "127.29.17.130" port: 33231 } } peers { permanent_uuid: "36efc1a3b89247c4b8eee0c35f8df5db" member_type: VOTER last_known_addr { host: "127.29.17.129" port: 44623 } } 08:29:15.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.883777 29766 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 30682 08:29:15.883 [DEBUG - Time-limited test] (MiniKuduCluster.java:165) Response: 08:29:15.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.887614 30813 heartbeater.cc:322] Connected to a master server at 127.29.17.189:43723 08:29:15.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.887763 30813 heartbeater.cc:406] Registering TS with master... 08:29:15.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.887785 30706 ts_tablet_manager.cc:1124] T 18971b825f5c4351b660bc2361d74795 P c42be8da4e7c41b2b590d87b4d029360: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s 08:29:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.887630 30814 heartbeater.cc:322] Connected to a master server at 127.29.17.190:44763 08:29:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.888200 30814 heartbeater.cc:406] Registering TS with master... 08:29:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.888211 30812 heartbeater.cc:322] Connected to a master server at 127.29.17.188:43575 08:29:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.888418 30812 heartbeater.cc:406] Registering TS with master... 08:29:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.888800 30812 heartbeater.cc:455] Master 127.29.17.188:43575 requested a full tablet report, sending... 08:29:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.888820 30814 heartbeater.cc:455] Master 127.29.17.190:44763 requested a full tablet report, sending... 08:29:15.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.890588 29932 ts_manager.cc:191] Re-registered known tserver with Master: c42be8da4e7c41b2b590d87b4d029360 (127.29.17.131:45411) 08:29:15.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.890631 29802 ts_manager.cc:191] Re-registered known tserver with Master: c42be8da4e7c41b2b590d87b4d029360 (127.29.17.131:45411) 08:29:15.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.891991 29932 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.29.17.131:36011 08:29:15.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.893738 30812 heartbeater.cc:447] Master 127.29.17.188:43575 was elected leader, sending a full tablet report... 08:29:15.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.901966 30813 heartbeater.cc:455] Master 127.29.17.189:43723 requested a full tablet report, sending... 08:29:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.903391 29868 ts_manager.cc:191] Re-registered known tserver with Master: c42be8da4e7c41b2b590d87b4d029360 (127.29.17.131:45411) 08:29:15.905 [DEBUG - New I/O worker #41] (Negotiator.java:764) Authenticated connection [id: 0x818c4ae0, /127.0.0.1:54832 => /127.29.17.129:44623] using TOKEN/null 08:29:15.914 [DEBUG - New I/O worker #39] (Connection.java:691) [peer master-127.29.17.190:44763(127.29.17.190:44763)] cleaning up while in state READY due to: connection disconnected 08:29:15.915 [DEBUG - New I/O worker #41] (Connection.java:691) [peer 36efc1a3b89247c4b8eee0c35f8df5db(127.29.17.129:44623)] cleaning up while in state READY due to: connection disconnected 08:29:15.916 [DEBUG - New I/O worker #37] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:15.916 [DEBUG - New I/O worker #38] (Connection.java:691) [peer master-127.29.17.188:43575(127.29.17.188:43575)] cleaning up while in state READY due to: connection disconnected 08:29:15.919 [DEBUG - New I/O worker #37] (Connection.java:691) [peer master-127.29.17.189:43723(127.29.17.189:43723)] cleaning up while in state READY due to: connection disconnected 08:29:15.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.919852 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 30551 08:29:15.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.923668 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 30417 08:29:15.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.927170 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 30682 08:29:15.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.931455 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 29775 08:29:15.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.935484 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 29840 08:29:15.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:15.939174 29766 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 29902 08:29:15.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:15Z chronyd exiting 08:29:15.962 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720155962 08:29:15.965 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:15.966 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:15.966 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:15.966 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:15.966 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:15.968 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042" hms_mode: NONE mini_kdc_options { } } 08:29:16.038 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:16.039 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:16.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:16Z Disabled control of system clock 08:29:16.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.055683 30825 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:16.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/wal 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/data 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.126:40313 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.126 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/logs 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/data/info.pb 08:29:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:16.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:16.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.109822 30834 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:16.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.110033 30834 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.111138 30834 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.111172 30834 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.111186 30834 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.111201 30834 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.113123 30834 master_main.cc:98] Master server non-default flags: 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/data 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/wal 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.126:40313 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/data/info.pb 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.126 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.30834 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/logs 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:16.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.120767 30834 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:16.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.122342 30834 hybrid_clock.cc:181] HybridClock initialized: now 1573720156122294 us; error 57 us; skew 500 ppm 08:29:16.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.122910 30834 fs_manager.cc:261] Metadata directory not provided 08:29:16.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.122961 30834 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:16.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.123279 30834 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:16.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.123311 30834 server_base.cc:453] Attempting to create new FS layout instead 08:29:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.125202 30834 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/data/instance: 08:29:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ff33839e43e94e409a97951ee52c77b6" 08:29:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.125524 30834 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/wal/instance: 08:29:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ff33839e43e94e409a97951ee52c77b6" 08:29:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.130818 30834 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s 08:29:16.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.131647 30834 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:16.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.132138 30834 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.135313 30834 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.135432 30834 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/wal 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ff33839e43e94e409a97951ee52c77b6" 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.135516 30834 fs_report.cc:352] FS layout report 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/wal 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/wal 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/data/data 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:16.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:16.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:16.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:16.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:16.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.158835 30834 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:16.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.165081 30834 rpc_server.cc:211] RPC server started. Bound to: 127.30.26.126:40313 08:29:16.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.165951 30834 webserver.cc:382] Webserver started at http://127.30.26.126:44645/ using document root and password file 08:29:16.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.166455 30834 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-0/data/info.pb 08:29:16.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.168903 30896 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:16.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.170763 30825 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 30834 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.171278 30825 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/wal 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/data 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.125:42475 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.125 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/logs 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/data/info.pb 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:16.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.177206 30896 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.188088 30896 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.188961 30896 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.26.125:42475: Network error: Client connection negotiation failed: client connection to 127.30.26.125:42475: connect: Connection refused (error 111) 08:29:16.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.208233 30896 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } attempt: 1 08:29:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.209403 30896 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.26.125:42475: Network error: Client connection negotiation failed: client connection to 127.30.26.125:42475: connect: Connection refused (error 111) 08:29:16.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:16.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.229843 30897 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:16.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.230039 30897 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.230983 30897 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.231010 30897 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.231017 30897 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.231026 30897 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.232832 30897 master_main.cc:98] Master server non-default flags: 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/data 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/wal 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.125:42475 08:29:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/data/info.pb 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.125 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.30897 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/logs 08:29:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:16.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.240628 30897 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:16.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.241819 30897 hybrid_clock.cc:181] HybridClock initialized: now 1573720156241786 us; error 32 us; skew 500 ppm 08:29:16.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.242400 30897 fs_manager.cc:261] Metadata directory not provided 08:29:16.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.242455 30897 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:16.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.242825 30897 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:16.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.242856 30897 server_base.cc:453] Attempting to create new FS layout instead 08:29:16.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.244712 30897 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/data/instance: 08:29:16.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" 08:29:16.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.245062 30897 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/wal/instance: 08:29:16.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" 08:29:16.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.251539 30897 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.002s sys 0.002s 08:29:16.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.252282 30897 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:16.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.252760 30897 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.256150 30897 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.256274 30897 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/wal 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.256390 30897 fs_report.cc:352] FS layout report 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/wal 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/wal 08:29:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/data/data 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:16.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.257623 30896 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } attempt: 2 08:29:16.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.258641 30896 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.26.125:42475: Network error: Client connection negotiation failed: client connection to 127.30.26.125:42475: connect: Connection refused (error 111) 08:29:16.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.283987 30897 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:16.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.289762 30897 rpc_server.cc:211] RPC server started. Bound to: 127.30.26.125:42475 08:29:16.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.290705 30897 webserver.cc:382] Webserver started at http://127.30.26.125:33271/ using document root and password file 08:29:16.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.291316 30897 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-1/data/info.pb 08:29:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.293969 30960 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.296173 30825 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 30897 08:29:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.296612 30825 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/wal 08:29:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/data 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.124:36363 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.124 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/logs 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/data/info.pb 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.297696 30960 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.306547 30960 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.312739 30960 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.313506 30960 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.26.124:36363: Network error: Client connection negotiation failed: client connection to 127.30.26.124:36363: connect: Connection refused (error 111) 08:29:16.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.332824 30960 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } attempt: 1 08:29:16.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.333925 30960 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.26.124:36363: Network error: Client connection negotiation failed: client connection to 127.30.26.124:36363: connect: Connection refused (error 111) 08:29:16.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:16.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.358211 30961 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:16.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.358408 30961 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:16.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.359334 30961 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:16.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.359359 30961 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:16.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.359366 30961 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:16.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.359375 30961 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.361099 30961 master_main.cc:98] Master server non-default flags: 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/data 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/wal 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.124:36363 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/data/info.pb 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.124 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:16.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.30961 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/logs 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:16.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.368156 30961 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:16.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.369318 30961 hybrid_clock.cc:181] HybridClock initialized: now 1573720156369271 us; error 51 us; skew 500 ppm 08:29:16.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.369833 30961 fs_manager.cc:261] Metadata directory not provided 08:29:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.369889 30961 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.369908 30896 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } attempt: 3 08:29:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.370108 30961 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.370128 30961 server_base.cc:453] Attempting to create new FS layout instead 08:29:16.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.372447 30961 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/data/instance: 08:29:16.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "2ad03f0bd54843c7b5de3b678e52943a" 08:29:16.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.372762 30961 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/wal/instance: 08:29:16.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "2ad03f0bd54843c7b5de3b678e52943a" 08:29:16.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.374480 30896 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.375198 30896 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.26.124:36363: Network error: Client connection negotiation failed: client connection to 127.30.26.124:36363: connect: Connection refused (error 111) 08:29:16.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.378602 30961 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.001s sys 0.003s 08:29:16.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.379417 30961 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:16.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.379901 30961 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:16.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.382087 30960 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } attempt: 2 08:29:16.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.382861 30960 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.26.124:36363: Network error: Client connection negotiation failed: client connection to 127.30.26.124:36363: connect: Connection refused (error 111) 08:29:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.383348 30961 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.383466 30961 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/wal 08:29:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "2ad03f0bd54843c7b5de3b678e52943a" 08:29:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.383592 30961 fs_report.cc:352] FS layout report 08:29:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/wal 08:29:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/wal 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/data/data 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:16.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.439430 30896 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } attempt: 1 08:29:16.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.440518 30896 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.26.124:36363: Network error: Client connection negotiation failed: client connection to 127.30.26.124:36363: connect: Connection refused (error 111) 08:29:16.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.461385 30961 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:16.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.466912 30961 rpc_server.cc:211] RPC server started. Bound to: 127.30.26.124:36363 08:29:16.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.467847 30961 webserver.cc:382] Webserver started at http://127.30.26.124:38109/ using document root and password file 08:29:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.468462 30961 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/master-2/data/info.pb 08:29:16.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.471968 31025 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:16.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.473155 30825 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 30961 08:29:16.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.473811 30825 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:16.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/wal 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/data 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.65:0 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.26.65 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.65 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/logs 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/data/info.pb 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.476428 31025 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.486644 31025 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.490800 31025 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } has no permanent_uuid. Determining permanent_uuid... 08:29:16.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.494032 30960 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } attempt: 3 08:29:16.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.500080 31025 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a: Bootstrap starting. 08:29:16.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.501057 30960 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0: Bootstrap starting. 08:29:16.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.502405 31025 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a: No blocks or log segments found. Creating new log. 08:29:16.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.502969 30960 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0: No blocks or log segments found. Creating new log. 08:29:16.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.503363 31025 log.cc:558] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a: Log is configured to *not* fsync() on all Append() calls 08:29:16.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.503829 30960 log.cc:558] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0: Log is configured to *not* fsync() on all Append() calls 08:29:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.505936 30960 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0: No bootstrap required, opened a new log 08:29:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.508410 30960 raft_consensus.cc:333] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.508491 30960 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.508533 30960 raft_consensus.cc:698] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddf0f67d8ef4b7ab44e4852997f3ea0, State: Initialized, Role: FOLLOWER 08:29:16.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.509014 30960 consensus_queue.cc:228] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.509325 30960 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.509361 30960 sys_catalog.cc:343] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.509861 31025 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a: No bootstrap required, opened a new log 08:29:16.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.510185 30960 sys_catalog.cc:428] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: configured and running, proceeding with master startup. 08:29:16.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.510619 31032 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.510679 31032 sys_catalog.cc:343] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.513041 31025 raft_consensus.cc:333] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.513144 31025 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:16.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.513188 31025 raft_consensus.cc:698] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad03f0bd54843c7b5de3b678e52943a, State: Initialized, Role: FOLLOWER 08:29:16.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.513739 31025 consensus_queue.cc:228] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.514139 31025 sys_catalog.cc:340] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.514187 31025 sys_catalog.cc:343] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.515151 31025 sys_catalog.cc:428] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: configured and running, proceeding with master startup. 08:29:16.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.515585 31035 sys_catalog.cc:340] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.515766 31035 sys_catalog.cc:343] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.516963 31033 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:16.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.517002 31033 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:16.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.518424 31036 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:16.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.518467 31036 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.519731 30896 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } attempt: 2 08:29:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.528513 30896 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6: Bootstrap starting. 08:29:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.531381 30896 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6: No blocks or log segments found. Creating new log. 08:29:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.532490 30896 log.cc:558] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6: Log is configured to *not* fsync() on all Append() calls 08:29:16.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:16.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.534305 31026 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:16.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.534590 31026 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:16.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.535854 31026 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:16.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.535931 31026 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.26.65 08:29:16.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.536406 30916 tablet.cc:1764] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:16.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.538066 30896 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6: No bootstrap required, opened a new log 08:29:16.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.538295 31026 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:16.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/data 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/wal 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.65:0 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/data/info.pb 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.65 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.31026 08:29:16.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.26.65 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/logs 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.542212 30896 raft_consensus.cc:333] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.542297 30896 raft_consensus.cc:359] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:16.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.542346 30896 raft_consensus.cc:698] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff33839e43e94e409a97951ee52c77b6, State: Initialized, Role: FOLLOWER 08:29:16.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.543015 30896 consensus_queue.cc:228] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.543421 30896 sys_catalog.cc:340] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.543452 30896 sys_catalog.cc:343] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.544551 30896 sys_catalog.cc:428] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: configured and running, proceeding with master startup. 08:29:16.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.548583 31026 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:16.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.549032 31043 sys_catalog.cc:340] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.549058 31043 sys_catalog.cc:343] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.549777 31026 hybrid_clock.cc:181] HybridClock initialized: now 1573720156549728 us; error 61 us; skew 500 ppm 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.550393 31026 fs_manager.cc:261] Metadata directory not provided 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.550442 31026 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.550711 31026 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.550740 31026 server_base.cc:453] Attempting to create new FS layout instead 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.552436 31044 catalog_manager.cc:1159] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.552469 31044 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.557211 31026 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/data/instance: 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "0a6bbe36ff83407592193973bc4c2b66" 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.557576 31026 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/wal/instance: 08:29:16.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "0a6bbe36ff83407592193973bc4c2b66" 08:29:16.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.570824 31026 fs_manager.cc:508] Time spent creating directory manager: real 0.013s user 0.006s sys 0.000s 08:29:16.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.572010 31026 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:16.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.572683 31026 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:16.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.582317 31026 fs_manager.cc:424] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s 08:29:16.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.582774 31026 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/wal 08:29:16.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "0a6bbe36ff83407592193973bc4c2b66" 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.583228 31026 fs_report.cc:352] FS layout report 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/wal 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/wal 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/data/data 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.619930 31026 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:16.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.625615 31026 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:16.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.625666 31026 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:16.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.643424 31026 rpc_server.cc:211] RPC server started. Bound to: 127.30.26.65:42977 08:29:16.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.644520 31026 webserver.cc:382] Webserver started at http://127.30.26.65:43143/ using document root and password file 08:29:16.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.645802 31026 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/data/info.pb 08:29:16.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.653093 30825 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 31026 08:29:16.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.653743 30825 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:16.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:16.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/wal 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/data 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.66:0 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.26.66 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.66 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/logs 08:29:16.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/data/info.pb 08:29:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:16.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.660378 30851 tablet.cc:1764] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:16.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.664206 31164 heartbeater.cc:322] Connected to a master server at 127.30.26.124:36363 08:29:16.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.664394 31164 heartbeater.cc:406] Registering TS with master... 08:29:16.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.664888 31166 heartbeater.cc:322] Connected to a master server at 127.30.26.126:40313 08:29:16.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.664928 31166 heartbeater.cc:406] Registering TS with master... 08:29:16.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.665194 31166 heartbeater.cc:455] Master 127.30.26.126:40313 requested a full tablet report, sending... 08:29:16.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.665464 31164 heartbeater.cc:455] Master 127.30.26.124:36363 requested a full tablet report, sending... 08:29:16.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.666756 31165 heartbeater.cc:322] Connected to a master server at 127.30.26.125:42475 08:29:16.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.666800 31165 heartbeater.cc:406] Registering TS with master... 08:29:16.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.666944 31165 heartbeater.cc:455] Master 127.30.26.125:42475 requested a full tablet report, sending... 08:29:16.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.667052 30854 ts_manager.cc:191] Registered new tserver with Master: 0a6bbe36ff83407592193973bc4c2b66 (127.30.26.65:42977) 08:29:16.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.668336 30991 ts_manager.cc:191] Registered new tserver with Master: 0a6bbe36ff83407592193973bc4c2b66 (127.30.26.65:42977) 08:29:16.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.668367 30927 ts_manager.cc:191] Registered new tserver with Master: 0a6bbe36ff83407592193973bc4c2b66 (127.30.26.65:42977) 08:29:16.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.712950 30980 tablet.cc:1764] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:16.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.735862 31043 raft_consensus.cc:465] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:16.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.736119 31043 raft_consensus.cc:487] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.737361 31043 leader_election.cc:296] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ddf0f67d8ef4b7ab44e4852997f3ea0 (127.30.26.125:42475), 2ad03f0bd54843c7b5de3b678e52943a (127.30.26.124:36363) 08:29:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.738276 30937 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff33839e43e94e409a97951ee52c77b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" is_pre_election: true 08:29:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.738276 31002 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff33839e43e94e409a97951ee52c77b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad03f0bd54843c7b5de3b678e52943a" is_pre_election: true 08:29:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.738510 30937 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff33839e43e94e409a97951ee52c77b6 in term 0. 08:29:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.738510 31002 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff33839e43e94e409a97951ee52c77b6 in term 0. 08:29:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.739014 30845 leader_election.cc:310] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad03f0bd54843c7b5de3b678e52943a, ff33839e43e94e409a97951ee52c77b6; no voters: 08:29:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.739295 31043 raft_consensus.cc:2649] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.739339 31043 raft_consensus.cc:465] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.739362 31043 raft_consensus.cc:2901] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 0 FOLLOWER]: Advancing to term 1 08:29:16.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.740563 31043 raft_consensus.cc:487] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.740890 31043 leader_election.cc:296] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [CANDIDATE]: Term 1 election: Requested vote from peers 6ddf0f67d8ef4b7ab44e4852997f3ea0 (127.30.26.125:42475), 2ad03f0bd54843c7b5de3b678e52943a (127.30.26.124:36363) 08:29:16.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.741288 31002 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff33839e43e94e409a97951ee52c77b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad03f0bd54843c7b5de3b678e52943a" 08:29:16.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.741338 30937 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff33839e43e94e409a97951ee52c77b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" 08:29:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.741349 31002 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [term 0 FOLLOWER]: Advancing to term 1 08:29:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.741394 30937 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [term 0 FOLLOWER]: Advancing to term 1 08:29:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.742502 30937 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff33839e43e94e409a97951ee52c77b6 in term 1. 08:29:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.742506 31002 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff33839e43e94e409a97951ee52c77b6 in term 1. 08:29:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.742836 30845 leader_election.cc:310] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad03f0bd54843c7b5de3b678e52943a, ff33839e43e94e409a97951ee52c77b6; no voters: 08:29:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.743080 31043 raft_consensus.cc:2649] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 1 FOLLOWER]: Leader election won for term 1 08:29:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.743311 31043 raft_consensus.cc:660] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [term 1 LEADER]: Becoming Leader. State: Replica: ff33839e43e94e409a97951ee52c77b6, State: Running, Role: LEADER 08:29:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.743707 31043 consensus_queue.cc:205] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } 08:29:16.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.749303 31172 sys_catalog.cc:340] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff33839e43e94e409a97951ee52c77b6. Latest consensus state: current_term: 1 leader_uuid: "ff33839e43e94e409a97951ee52c77b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.749359 31172 sys_catalog.cc:343] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: This master's current role is: LEADER 08:29:16.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.750735 31174 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:16.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.751785 31174 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:16.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:16.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.757529 31171 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:16.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.757771 31171 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:16.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.758839 31171 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:16.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.758924 31171 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.26.66 08:29:16.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.760613 31171 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:16.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/data 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/wal 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.66:0 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/data/info.pb 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.66 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:16.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.31171 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.26.66 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/logs 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:16.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.776927 31171 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:16.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.778139 31171 hybrid_clock.cc:181] HybridClock initialized: now 1573720156778102 us; error 22 us; skew 500 ppm 08:29:16.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.778826 31171 fs_manager.cc:261] Metadata directory not provided 08:29:16.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.778882 31171 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:16.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.779148 31171 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:16.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.779184 31171 server_base.cc:453] Attempting to create new FS layout instead 08:29:16.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.781944 31171 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/data/instance: 08:29:16.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e24c13e336d94953bc4c3576f22313ee" 08:29:16.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.782316 31171 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/wal/instance: 08:29:16.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e24c13e336d94953bc4c3576f22313ee" 08:29:16.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.787220 31002 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [term 1 FOLLOWER]: Refusing update from remote peer ff33839e43e94e409a97951ee52c77b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:16.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.787503 30937 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [term 1 FOLLOWER]: Refusing update from remote peer ff33839e43e94e409a97951ee52c77b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:16.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.788076 31043 consensus_queue.cc:981] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:16.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.788241 31172 consensus_queue.cc:981] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:16.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.789273 31171 fs_manager.cc:508] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s 08:29:16.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.790136 31171 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:16.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.790643 31171 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:16.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.792019 31032 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff33839e43e94e409a97951ee52c77b6. Latest consensus state: current_term: 1 leader_uuid: "ff33839e43e94e409a97951ee52c77b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.792026 31035 sys_catalog.cc:340] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff33839e43e94e409a97951ee52c77b6. Latest consensus state: current_term: 1 leader_uuid: "ff33839e43e94e409a97951ee52c77b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.792065 31032 sys_catalog.cc:343] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.792071 31035 sys_catalog.cc:343] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.793893 31171 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.793987 31171 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/wal 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e24c13e336d94953bc4c3576f22313ee" 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.794057 31171 fs_report.cc:352] FS layout report 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/wal 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/wal 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/data/data 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:16.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:16.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:16.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:16.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:16.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:16.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:16.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.797269 31043 sys_catalog.cc:340] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ff33839e43e94e409a97951ee52c77b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.797312 31043 sys_catalog.cc:343] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: This master's current role is: LEADER 08:29:16.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.797504 31032 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ff33839e43e94e409a97951ee52c77b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.797529 31032 sys_catalog.cc:343] T 00000000000000000000000000000000 P 6ddf0f67d8ef4b7ab44e4852997f3ea0 [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.797736 31182 mvcc.cc:203] Tried to move safe_time back from 6445957762192273408 to 6445957762024812544. Current Snapshot: MvccSnapshot[committed={T|T < 6445957762192273408}] 08:29:16.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.798171 31172 sys_catalog.cc:340] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ff33839e43e94e409a97951ee52c77b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.798198 31172 sys_catalog.cc:343] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6 [sys.catalog]: This master's current role is: LEADER 08:29:16.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.798346 31180 mvcc.cc:203] Tried to move safe_time back from 6445957762192273408 to 6445957762024812544. Current Snapshot: MvccSnapshot[committed={T|T < 6445957762192273408}] 08:29:16.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.799180 31035 sys_catalog.cc:340] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ff33839e43e94e409a97951ee52c77b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff33839e43e94e409a97951ee52c77b6" member_type: VOTER last_known_addr { host: "127.30.26.126" port: 40313 } } peers { permanent_uuid: "6ddf0f67d8ef4b7ab44e4852997f3ea0" member_type: VOTER last_known_addr { host: "127.30.26.125" port: 42475 } } peers { permanent_uuid: "2ad03f0bd54843c7b5de3b678e52943a" member_type: VOTER last_known_addr { host: "127.30.26.124" port: 36363 } } } 08:29:16.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.799230 31035 sys_catalog.cc:343] T 00000000000000000000000000000000 P 2ad03f0bd54843c7b5de3b678e52943a [sys.catalog]: This master's current role is: FOLLOWER 08:29:16.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.803027 31174 catalog_manager.cc:985] Generated new certificate authority record 08:29:16.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.804095 31174 catalog_manager.cc:1110] Loading token signing keys... 08:29:16.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.811152 31174 catalog_manager.cc:4455] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6: Generated new TSK 0 08:29:16.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.811691 31174 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:16.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.893108 31171 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:16.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.894273 31171 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:16.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.894302 31171 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:16.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.902809 31171 rpc_server.cc:211] RPC server started. Bound to: 127.30.26.66:38647 08:29:16.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.903700 31171 webserver.cc:382] Webserver started at http://127.30.26.66:37885/ using document root and password file 08:29:16.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.904260 31171 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/data/info.pb 08:29:16.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.914099 30825 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 31171 08:29:16.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.914446 31308 heartbeater.cc:322] Connected to a master server at 127.30.26.126:40313 08:29:16.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.914443 31306 heartbeater.cc:322] Connected to a master server at 127.30.26.124:36363 08:29:16.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.914623 31308 heartbeater.cc:406] Registering TS with master... 08:29:16.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.914624 31306 heartbeater.cc:406] Registering TS with master... 08:29:16.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.914746 30825 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:16.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:16.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/wal 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/data 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.67:0 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.26.67 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.67 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/logs 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/data/info.pb 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.915189 31306 heartbeater.cc:455] Master 127.30.26.124:36363 requested a full tablet report, sending... 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.915197 31308 heartbeater.cc:455] Master 127.30.26.126:40313 requested a full tablet report, sending... 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.916124 31307 heartbeater.cc:322] Connected to a master server at 127.30.26.125:42475 08:29:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.916172 31307 heartbeater.cc:406] Registering TS with master... 08:29:16.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.916215 30854 ts_manager.cc:191] Registered new tserver with Master: e24c13e336d94953bc4c3576f22313ee (127.30.26.66:38647) 08:29:16.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.916306 31307 heartbeater.cc:455] Master 127.30.26.125:42475 requested a full tablet report, sending... 08:29:16.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.916334 30991 ts_manager.cc:191] Registered new tserver with Master: e24c13e336d94953bc4c3576f22313ee (127.30.26.66:38647) 08:29:16.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.917258 30927 ts_manager.cc:191] Registered new tserver with Master: e24c13e336d94953bc4c3576f22313ee (127.30.26.66:38647) 08:29:16.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.918056 30854 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.30.26.66:41027 08:29:16.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:16.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.961903 31313 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:16.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.962105 31313 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:16.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.963161 31313 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:16.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:16.963243 31313 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.26.67 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.964972 31313 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.26.84:33323 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/data 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/wal 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.26.67:0 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:16.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/data/info.pb 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.26.67 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.26.126:40313,127.30.26.125:42475,127.30.26.124:36363 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.31313 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.26.67 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/logs 08:29:16.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:16.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.972573 31313 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:16.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.973783 31313 hybrid_clock.cc:181] HybridClock initialized: now 1573720156973745 us; error 48 us; skew 500 ppm 08:29:16.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.974253 31313 fs_manager.cc:261] Metadata directory not provided 08:29:16.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.974303 31313 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:16.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.974555 31313 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:16.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.974583 31313 server_base.cc:453] Attempting to create new FS layout instead 08:29:16.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.976290 31313 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/data/instance: 08:29:16.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "afd9b21b7e7d4794824a8cc33468a702" 08:29:16.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.976599 31313 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/wal/instance: 08:29:16.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "afd9b21b7e7d4794824a8cc33468a702" 08:29:16.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.981495 31313 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s 08:29:16.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.982340 31313 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:16.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.982844 31313 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:16.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.985901 31313 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.986021 31313 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/wal 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "afd9b21b7e7d4794824a8cc33468a702" 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:16 on dist-test-slave-dist-test-slave-05kx" 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:16.986106 31313 fs_report.cc:352] FS layout report 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/wal 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/wal 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/data/data 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:16.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:17.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.042084 31313 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:17.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.043432 31313 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:17.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.043467 31313 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:17.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.052563 31313 rpc_server.cc:211] RPC server started. Bound to: 127.30.26.67:44269 08:29:17.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.053588 31313 webserver.cc:382] Webserver started at http://127.30.26.67:42005/ using document root and password file 08:29:17.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.054076 31313 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/data/info.pb 08:29:17.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.061550 30825 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 31313 08:29:17.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.063851 31435 heartbeater.cc:322] Connected to a master server at 127.30.26.124:36363 08:29:17.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.063879 31437 heartbeater.cc:322] Connected to a master server at 127.30.26.126:40313 08:29:17.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.064011 31435 heartbeater.cc:406] Registering TS with master... 08:29:17.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.064055 31436 heartbeater.cc:322] Connected to a master server at 127.30.26.125:42475 08:29:17.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.064085 31436 heartbeater.cc:406] Registering TS with master... 08:29:17.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.064394 31435 heartbeater.cc:455] Master 127.30.26.124:36363 requested a full tablet report, sending... 08:29:17.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.064401 31436 heartbeater.cc:455] Master 127.30.26.125:42475 requested a full tablet report, sending... 08:29:17.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.064018 31437 heartbeater.cc:406] Registering TS with master... 08:29:17.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.065507 31437 heartbeater.cc:455] Master 127.30.26.126:40313 requested a full tablet report, sending... 08:29:17.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.065506 30991 ts_manager.cc:191] Registered new tserver with Master: afd9b21b7e7d4794824a8cc33468a702 (127.30.26.67:44269) 08:29:17.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.065507 30927 ts_manager.cc:191] Registered new tserver with Master: afd9b21b7e7d4794824a8cc33468a702 (127.30.26.67:44269) 08:29:17.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.066304 30854 ts_manager.cc:191] Registered new tserver with Master: afd9b21b7e7d4794824a8cc33468a702 (127.30.26.67:44269) 08:29:17.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.067355 30854 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.30.26.67:57279 08:29:17.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.081316 30825 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:17.081 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:17.081 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:17.082 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.30.26.126" port: 40313 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.30.26.125" port: 42475 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.30.26.124" port: 36363 } } } 08:29:17.082 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:17.083 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.30.26.65" port: 42977 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.30.26.66" port: 38647 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.30.26.67" port: 44269 } } } 08:29:17.083 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:17.087 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:17.098 [DEBUG - New I/O worker #46] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.30.26.126 08:29:17.098 [DEBUG - New I/O worker #47] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.30.26.124 08:29:17.099 [DEBUG - New I/O worker #48] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.30.26.125 08:29:17.107 [DEBUG - New I/O worker #47] (Negotiator.java:764) Authenticated connection [id: 0x957822e9, /127.0.0.1:59318 => /127.30.26.124:36363] using SASL/PLAIN 08:29:17.108 [DEBUG - New I/O worker #48] (Negotiator.java:764) Authenticated connection [id: 0x509f56c5, /127.0.0.1:42934 => /127.30.26.125:42475] using SASL/PLAIN 08:29:17.110 [DEBUG - New I/O worker #46] (Negotiator.java:764) Authenticated connection [id: 0xb2924e84, /127.0.0.1:47040 => /127.30.26.126:40313] using SASL/PLAIN 08:29:17.113 [DEBUG - New I/O worker #46] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:17.113 [DEBUG - New I/O worker #46] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=25), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.26.126:40313, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.26.124:36363, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.26.125:42475, [23ms] Sub RPC ConnectToMaster: received response from server master-127.30.26.125:42475: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.30.26.124:36363: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.30.26.126:40313: OK, deferred=null) after lookup 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.117130 30854 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47040: 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:17.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:17.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.118343 30854 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:17.128 [DEBUG - New I/O worker #46] (AsyncKuduClient.java:777) Opened table bba17e20ec6e43b98e46e8cce24d9cee 08:29:17.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.138164 31372 tablet_service.cc:1023] Processing CreateTablet for tablet 40ff3ec3019e461c9ec0c7a7e148bc91 (table=org.apache.kudu.client.TestAsyncKuduSession [id=bba17e20ec6e43b98e46e8cce24d9cee]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:17.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.138778 31372 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 40ff3ec3019e461c9ec0c7a7e148bc91. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:17.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.139071 31242 tablet_service.cc:1023] Processing CreateTablet for tablet 40ff3ec3019e461c9ec0c7a7e148bc91 (table=org.apache.kudu.client.TestAsyncKuduSession [id=bba17e20ec6e43b98e46e8cce24d9cee]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:17.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.139636 31242 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 40ff3ec3019e461c9ec0c7a7e148bc91. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:17.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.139853 31094 tablet_service.cc:1023] Processing CreateTablet for tablet 40ff3ec3019e461c9ec0c7a7e148bc91 (table=org.apache.kudu.client.TestAsyncKuduSession [id=bba17e20ec6e43b98e46e8cce24d9cee]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:17.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.140261 31094 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 40ff3ec3019e461c9ec0c7a7e148bc91. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:17.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.145933 31459 tablet_bootstrap.cc:439] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: Bootstrap starting. 08:29:17.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.147394 31459 tablet_bootstrap.cc:590] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: No blocks or log segments found. Creating new log. 08:29:17.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.148036 31459 log.cc:558] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: Log is configured to *not* fsync() on all Append() calls 08:29:17.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.148587 31461 tablet_bootstrap.cc:439] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: Bootstrap starting. 08:29:17.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.149047 31460 tablet_bootstrap.cc:439] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: Bootstrap starting. 08:29:17.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.150259 31460 tablet_bootstrap.cc:590] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: No blocks or log segments found. Creating new log. 08:29:17.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.150948 31460 log.cc:558] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: Log is configured to *not* fsync() on all Append() calls 08:29:17.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.152274 31460 tablet_bootstrap.cc:439] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: No bootstrap required, opened a new log 08:29:17.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.152457 31460 ts_tablet_manager.cc:1096] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s 08:29:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.153311 31461 tablet_bootstrap.cc:590] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: No blocks or log segments found. Creating new log. 08:29:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.153738 31459 tablet_bootstrap.cc:439] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: No bootstrap required, opened a new log 08:29:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.153894 31459 ts_tablet_manager.cc:1096] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s 08:29:17.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.154157 31461 log.cc:558] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: Log is configured to *not* fsync() on all Append() calls 08:29:17.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.156430 31459 raft_consensus.cc:333] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.156507 31459 raft_consensus.cc:359] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:17.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.156539 31459 raft_consensus.cc:698] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd9b21b7e7d4794824a8cc33468a702, State: Initialized, Role: FOLLOWER 08:29:17.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.158594 31460 raft_consensus.cc:333] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.158660 31460 raft_consensus.cc:359] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:17.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.158689 31460 raft_consensus.cc:698] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e24c13e336d94953bc4c3576f22313ee, State: Initialized, Role: FOLLOWER 08:29:17.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.158941 31460 consensus_queue.cc:228] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.160197 31308 heartbeater.cc:447] Master 127.30.26.126:40313 was elected leader, sending a full tablet report... 08:29:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.160398 31461 tablet_bootstrap.cc:439] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: No bootstrap required, opened a new log 08:29:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.160560 31460 ts_tablet_manager.cc:1124] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s 08:29:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.160560 31461 ts_tablet_manager.cc:1096] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s 08:29:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.160912 31459 consensus_queue.cc:228] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.163189 31437 heartbeater.cc:447] Master 127.30.26.126:40313 was elected leader, sending a full tablet report... 08:29:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.165400 31459 ts_tablet_manager.cc:1124] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s 08:29:17.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.172403 31461 raft_consensus.cc:333] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.172494 31461 raft_consensus.cc:359] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:17.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.172531 31461 raft_consensus.cc:698] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6bbe36ff83407592193973bc4c2b66, State: Initialized, Role: FOLLOWER 08:29:17.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.173013 31461 consensus_queue.cc:228] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.175837 30854 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.30.26.65:42335 08:29:17.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.177103 31461 ts_tablet_manager.cc:1124] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s 08:29:17.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.177681 31166 heartbeater.cc:447] Master 127.30.26.126:40313 was elected leader, sending a full tablet report... 08:29:17.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.226817 31466 raft_consensus.cc:465] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:17.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.227023 31466 raft_consensus.cc:487] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.228066 31466 leader_election.cc:296] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6bbe36ff83407592193973bc4c2b66 (127.30.26.65:42977), e24c13e336d94953bc4c3576f22313ee (127.30.26.66:38647) 08:29:17.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.233098 31105 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "40ff3ec3019e461c9ec0c7a7e148bc91" candidate_uuid: "afd9b21b7e7d4794824a8cc33468a702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6bbe36ff83407592193973bc4c2b66" is_pre_election: true 08:29:17.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.233184 31262 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "40ff3ec3019e461c9ec0c7a7e148bc91" candidate_uuid: "afd9b21b7e7d4794824a8cc33468a702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e24c13e336d94953bc4c3576f22313ee" is_pre_election: true 08:29:17.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.233316 31262 raft_consensus.cc:2355] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd9b21b7e7d4794824a8cc33468a702 in term 0. 08:29:17.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.233345 31105 raft_consensus.cc:2355] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afd9b21b7e7d4794824a8cc33468a702 in term 0. 08:29:17.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.233770 31323 leader_election.cc:310] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afd9b21b7e7d4794824a8cc33468a702, e24c13e336d94953bc4c3576f22313ee; no voters: 08:29:17.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.234104 31466 raft_consensus.cc:2649] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:17.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.234174 31466 raft_consensus.cc:465] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:17.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.234212 31466 raft_consensus.cc:2901] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 0 FOLLOWER]: Advancing to term 1 08:29:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.235327 31466 raft_consensus.cc:487] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.235752 31466 leader_election.cc:296] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6bbe36ff83407592193973bc4c2b66 (127.30.26.65:42977), e24c13e336d94953bc4c3576f22313ee (127.30.26.66:38647) 08:29:17.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.236122 31105 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "40ff3ec3019e461c9ec0c7a7e148bc91" candidate_uuid: "afd9b21b7e7d4794824a8cc33468a702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6bbe36ff83407592193973bc4c2b66" 08:29:17.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.236166 31262 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "40ff3ec3019e461c9ec0c7a7e148bc91" candidate_uuid: "afd9b21b7e7d4794824a8cc33468a702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e24c13e336d94953bc4c3576f22313ee" 08:29:17.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.236194 31105 raft_consensus.cc:2901] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 0 FOLLOWER]: Advancing to term 1 08:29:17.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.236210 31262 raft_consensus.cc:2901] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 0 FOLLOWER]: Advancing to term 1 08:29:17.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.237113 31262 raft_consensus.cc:2355] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd9b21b7e7d4794824a8cc33468a702 in term 1. 08:29:17.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.237272 31105 raft_consensus.cc:2355] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afd9b21b7e7d4794824a8cc33468a702 in term 1. 08:29:17.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.237447 31323 leader_election.cc:310] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afd9b21b7e7d4794824a8cc33468a702, e24c13e336d94953bc4c3576f22313ee; no voters: 08:29:17.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.237639 31466 raft_consensus.cc:2649] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 1 FOLLOWER]: Leader election won for term 1 08:29:17.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.237805 31466 raft_consensus.cc:660] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 1 LEADER]: Becoming Leader. State: Replica: afd9b21b7e7d4794824a8cc33468a702, State: Running, Role: LEADER 08:29:17.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.238072 31466 consensus_queue.cc:205] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } } 08:29:17.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.241498 30854 catalog_manager.cc:4143] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 reported cstate change: term changed from 0 to 1, leader changed from to afd9b21b7e7d4794824a8cc33468a702 (127.30.26.67). New cstate: current_term: 1 leader_uuid: "afd9b21b7e7d4794824a8cc33468a702" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afd9b21b7e7d4794824a8cc33468a702" member_type: VOTER last_known_addr { host: "127.30.26.67" port: 44269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 } health_report { overall_health: UNKNOWN } } } 08:29:17.274 [DEBUG - New I/O worker #46] (AsyncKuduClient.java:2346) Learned about tablet 40ff3ec3019e461c9ec0c7a7e148bc91 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:17.274 [DEBUG - New I/O worker #46] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=40ff3ec3019e461c9ec0c7a7e148bc91@[0a6bbe36ff83407592193973bc4c2b66(127.30.26.65:42977),afd9b21b7e7d4794824a8cc33468a702(127.30.26.67:44269)[L],e24c13e336d94953bc4c3576f22313ee(127.30.26.66:38647)]}] 08:29:17.274 [DEBUG - New I/O worker #46] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=2), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.26.126:40313, [2ms] Sub RPC GetTableLocations: received response from server master-127.30.26.126:40313: OK, deferred=null) after lookup 08:29:17.287 [DEBUG - New I/O worker #49] (Negotiator.java:764) Authenticated connection [id: 0xaf0a2ec2, /127.0.0.1:45032 => /127.30.26.67:44269] using TOKEN/null 08:29:17.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.298863 31105 raft_consensus.cc:1177] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 1 FOLLOWER]: Refusing update from remote peer afd9b21b7e7d4794824a8cc33468a702: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:17.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.298923 31262 raft_consensus.cc:1177] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 1 FOLLOWER]: Refusing update from remote peer afd9b21b7e7d4794824a8cc33468a702: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:17.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.299645 31466 consensus_queue.cc:981] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6bbe36ff83407592193973bc4c2b66" member_type: VOTER last_known_addr { host: "127.30.26.65" port: 42977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:17.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.299769 31468 consensus_queue.cc:981] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e24c13e336d94953bc4c3576f22313ee" member_type: VOTER last_known_addr { host: "127.30.26.66" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:17.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.305739 31438 tablet.cc:1764] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:17.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.309234 31471 mvcc.cc:203] Tried to move safe_time back from 6445957764287139840 to 6445957764048863232. Current Snapshot: MvccSnapshot[committed={T|T < 6445957764287139840}] 08:29:17.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.311982 31472 mvcc.cc:203] Tried to move safe_time back from 6445957764287139840 to 6445957764048863232. Current Snapshot: MvccSnapshot[committed={T|T < 6445957764287139840 or (T in {6445957764287139840})}] 08:29:17.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.323784 30855 catalog_manager.cc:1951] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47040: 08:29:17.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) table { table_name: "org.apache.kudu.client.TestAsyncKuduSession" } 08:29:17.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.329109 30855 catalog_manager.cc:4390] T 00000000000000000000000000000000 P ff33839e43e94e409a97951ee52c77b6: Sending DeleteTablet for 3 replicas of tablet 40ff3ec3019e461c9ec0c7a7e148bc91 08:29:17.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.330303 31242 tablet_service.cc:1067] Processing DeleteTablet for tablet 40ff3ec3019e461c9ec0c7a7e148bc91 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-11-14 08:29:17 UTC) from {username='slave'} at 127.0.0.1:38516 08:29:17.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.330339 31094 tablet_service.cc:1067] Processing DeleteTablet for tablet 40ff3ec3019e461c9ec0c7a7e148bc91 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-11-14 08:29:17 UTC) from {username='slave'} at 127.0.0.1:46416 08:29:17.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.330879 31479 tablet_replica.cc:276] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: stopping tablet replica 08:29:17.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.331140 31479 raft_consensus.cc:2152] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 1 FOLLOWER]: Raft consensus shutting down. 08:29:17.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.331593 31372 tablet_service.cc:1067] Processing DeleteTablet for tablet 40ff3ec3019e461c9ec0c7a7e148bc91 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-11-14 08:29:17 UTC) from {username='slave'} at 127.0.0.1:45026 08:29:17.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.331615 31480 tablet_replica.cc:276] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: stopping tablet replica 08:29:17.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.331820 31480 raft_consensus.cc:2152] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 1 FOLLOWER]: Raft consensus shutting down. 08:29:17.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.332021 31480 raft_consensus.cc:2179] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66 [term 1 FOLLOWER]: Raft consensus is shut down! 08:29:17.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.332455 31481 tablet_replica.cc:276] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: stopping tablet replica 08:29:17.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.332690 31481 raft_consensus.cc:2152] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 1 LEADER]: Raft consensus shutting down. 08:29:17.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.332974 31479 raft_consensus.cc:2179] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee [term 1 FOLLOWER]: Raft consensus is shut down! 08:29:17.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.334589 31479 ts_tablet_manager.cc:1449] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: Deleting tablet data with delete state TABLET_DATA_DELETED 08:29:17.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.335017 31481 raft_consensus.cc:2179] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702 [term 1 FOLLOWER]: Raft consensus is shut down! 08:29:17.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.335348 31480 ts_tablet_manager.cc:1449] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: Deleting tablet data with delete state TABLET_DATA_DELETED 08:29:17.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.336558 31481 ts_tablet_manager.cc:1449] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: Deleting tablet data with delete state TABLET_DATA_DELETED 08:29:17.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.338431 31480 ts_tablet_manager.cc:1462] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2 08:29:17.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.338644 31480 log.cc:1038] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: Deleting WAL directory at /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-0/wal/wals/40ff3ec3019e461c9ec0c7a7e148bc91 08:29:17.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.339238 31480 ts_tablet_manager.cc:1483] T 40ff3ec3019e461c9ec0c7a7e148bc91 P 0a6bbe36ff83407592193973bc4c2b66: Deleting consensus metadata 08:29:17.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.340629 31481 ts_tablet_manager.cc:1462] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2 08:29:17.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.340901 31481 log.cc:1038] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: Deleting WAL directory at /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-2/wal/wals/40ff3ec3019e461c9ec0c7a7e148bc91 08:29:17.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.341342 31481 ts_tablet_manager.cc:1483] T 40ff3ec3019e461c9ec0c7a7e148bc91 P afd9b21b7e7d4794824a8cc33468a702: Deleting consensus metadata 08:29:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.345747 30843 catalog_manager.cc:3512] TS afd9b21b7e7d4794824a8cc33468a702 (127.30.26.67:44269): tablet 40ff3ec3019e461c9ec0c7a7e148bc91 (table org.apache.kudu.client.TestAsyncKuduSession [id=bba17e20ec6e43b98e46e8cce24d9cee]) successfully deleted 08:29:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.346603 30845 catalog_manager.cc:3512] TS 0a6bbe36ff83407592193973bc4c2b66 (127.30.26.65:42977): tablet 40ff3ec3019e461c9ec0c7a7e148bc91 (table org.apache.kudu.client.TestAsyncKuduSession [id=bba17e20ec6e43b98e46e8cce24d9cee]) successfully deleted 08:29:17.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.348831 31479 ts_tablet_manager.cc:1462] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2 08:29:17.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.349048 31479 log.cc:1038] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: Deleting WAL directory at /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster7173933654018441042/ts-1/wal/wals/40ff3ec3019e461c9ec0c7a7e148bc91 08:29:17.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.349689 31479 ts_tablet_manager.cc:1483] T 40ff3ec3019e461c9ec0c7a7e148bc91 P e24c13e336d94953bc4c3576f22313ee: Deleting consensus metadata 08:29:17.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.351457 30844 catalog_manager.cc:3512] TS e24c13e336d94953bc4c3576f22313ee (127.30.26.66:38647): tablet 40ff3ec3019e461c9ec0c7a7e148bc91 (table org.apache.kudu.client.TestAsyncKuduSession [id=bba17e20ec6e43b98e46e8cce24d9cee]) successfully deleted 08:29:17.455 [INFO - New I/O worker #49] (AsyncKuduClient.java:2157) Invalidating location afd9b21b7e7d4794824a8cc33468a702(127.30.26.67:44269) for tablet 40ff3ec3019e461c9ec0c7a7e148bc91: Tablet not found: 40ff3ec3019e461c9ec0c7a7e148bc91 08:29:17.473 [DEBUG - New I/O worker #46] (AsyncKuduClient.java:1348) Notify RPC KuduRpc(method=Write, tablet=40ff3ec3019e461c9ec0c7a7e148bc91, attempt=2, TimeoutTracker(timeout=30000, elapsed=20), Traces: [0ms] sending RPC to server afd9b21b7e7d4794824a8cc33468a702, [3ms] delaying RPC due to: Not found: Tablet not found: 40ff3ec3019e461c9ec0c7a7e148bc91 (error 0), [3ms] received response from server afd9b21b7e7d4794824a8cc33468a702: Not found: Tablet not found: 40ff3ec3019e461c9ec0c7a7e148bc91 (error 0), [17ms] refreshing cache from master, [17ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.26.126:40313, [21ms] Sub RPC GetTableLocations: received response from server master-127.30.26.126:40313: Not found: table org.apache.kudu.client.TestAsyncKuduSession was deleted: Table deleted at 2019-11-14 08:29:17 UTC (error 0), deferred=Deferred@1388128383(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$20/1893960929@7125b68b -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@632538e9 -> wakeup thread Time-limited test)) after lookup exception org.apache.kudu.client.NonRecoverableException: table org.apache.kudu.client.TestAsyncKuduSession was deleted: Table deleted at 2019-11-14 08:29:17 UTC at org.apache.kudu.client.RpcProxy.dispatchMasterError(RpcProxy.java:386) ~[main/:?] at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:279) [main/:?] at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:59) [main/:?] at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:149) [main/:?] at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:145) [main/:?] at org.apache.kudu.client.Connection.messageReceived(Connection.java:390) [main/:?] at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [netty-3.10.6.Final.jar:?] at org.apache.kudu.client.Connection.handleUpstream(Connection.java:238) [main/:?] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) [netty-3.10.6.Final.jar:?] at org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:70) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) [netty-3.10.6.Final.jar:?] at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) [netty-3.10.6.Final.jar:?] at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) [netty-3.10.6.Final.jar:?] at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) [netty-3.10.6.Final.jar:?] at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) [netty-3.10.6.Final.jar:?] at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) [netty-3.10.6.Final.jar:?] at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) [netty-3.10.6.Final.jar:?] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) [netty-3.10.6.Final.jar:?] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [netty-3.10.6.Final.jar:?] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [netty-3.10.6.Final.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_141] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_141] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_141] 08:29:17.476 [DEBUG - New I/O worker #46] (Connection.java:691) [peer master-127.30.26.126:40313(127.30.26.126:40313)] cleaning up while in state READY due to: connection disconnected 08:29:17.478 [DEBUG - New I/O worker #48] (Connection.java:691) [peer master-127.30.26.125:42475(127.30.26.125:42475)] cleaning up while in state READY due to: connection disconnected 08:29:17.478 [DEBUG - New I/O worker #49] (Connection.java:691) [peer afd9b21b7e7d4794824a8cc33468a702(127.30.26.67:44269)] cleaning up while in state READY due to: connection disconnected 08:29:17.478 [DEBUG - New I/O worker #47] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:17.479 [DEBUG - New I/O worker #47] (Connection.java:691) [peer master-127.30.26.124:36363(127.30.26.124:36363)] cleaning up while in state READY due to: connection disconnected 08:29:17.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.479897 30825 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 31026 08:29:17.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.485311 30825 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 31171 08:29:17.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.489483 30825 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 31313 08:29:17.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.493091 30825 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 30834 08:29:17.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.496985 30825 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 30897 08:29:17.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.500847 30825 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 30961 08:29:17.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:17Z chronyd exiting 08:29:17.523 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720157523 08:29:17.526 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:17.527 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:17.527 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:17.527 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:17.527 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:17.529 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221" hms_mode: NONE mini_kdc_options { } } 08:29:17.608 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:17.608 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:17.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:17.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:17Z Disabled control of system clock 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.625957 31484 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/wal 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/data 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.62:35879 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.62 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/logs 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/data/info.pb 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.682341 31493 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.682554 31493 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:17.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.683508 31493 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:17.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.683537 31493 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:17.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.683545 31493 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:17.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.683553 31493 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.685413 31493 master_main.cc:98] Master server non-default flags: 08:29:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/data 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/wal 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.62:35879 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/data/info.pb 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.62 08:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.31493 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/logs 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:17.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:17.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.693336 31493 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.694551 31493 hybrid_clock.cc:181] HybridClock initialized: now 1573720157694508 us; error 43 us; skew 500 ppm 08:29:17.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.695078 31493 fs_manager.cc:261] Metadata directory not provided 08:29:17.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.695133 31493 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:17.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.695443 31493 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:17.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.695475 31493 server_base.cc:453] Attempting to create new FS layout instead 08:29:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.697403 31493 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/data/instance: 08:29:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "46ce17726154405c80be7f007b0e9467" 08:29:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:17 on dist-test-slave-dist-test-slave-05kx" 08:29:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.697749 31493 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/wal/instance: 08:29:17.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "46ce17726154405c80be7f007b0e9467" 08:29:17.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:17 on dist-test-slave-dist-test-slave-05kx" 08:29:17.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.711004 31493 fs_manager.cc:508] Time spent creating directory manager: real 0.013s user 0.002s sys 0.002s 08:29:17.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.711838 31493 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:17.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.712345 31493 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.715504 31493 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.715745 31493 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/wal 08:29:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "46ce17726154405c80be7f007b0e9467" 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:17 on dist-test-slave-dist-test-slave-05kx" 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.715869 31493 fs_report.cc:352] FS layout report 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/wal 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/wal 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/data/data 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:17.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:17.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:17.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:17.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.760505 31493 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:17.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.765496 31493 rpc_server.cc:211] RPC server started. Bound to: 127.30.191.62:35879 08:29:17.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.766281 31493 webserver.cc:382] Webserver started at http://127.30.191.62:42977/ using document root and password file 08:29:17.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.766818 31493 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-0/data/info.pb 08:29:17.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.769356 31556 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:17.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.771872 31484 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 31493 08:29:17.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.772567 31484 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:17.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:17.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/wal 08:29:17.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/data 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.61:43515 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.61 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/logs 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/data/info.pb 08:29:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:17.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.772642 31556 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } has no permanent_uuid. Determining permanent_uuid... 08:29:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.783226 31556 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } has no permanent_uuid. Determining permanent_uuid... 08:29:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.784175 31556 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.191.61:43515: Network error: Client connection negotiation failed: client connection to 127.30.191.61:43515: connect: Connection refused (error 111) 08:29:17.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.803516 31556 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } attempt: 1 08:29:17.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.804689 31556 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.191.61:43515: Network error: Client connection negotiation failed: client connection to 127.30.191.61:43515: connect: Connection refused (error 111) 08:29:17.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:17.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.830544 31557 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.830773 31557 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.831884 31557 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:17.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.831915 31557 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:17.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.831928 31557 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:17.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.831940 31557 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:17.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.833865 31557 master_main.cc:98] Master server non-default flags: 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/data 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/wal 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.61:43515 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/data/info.pb 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.61 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.31557 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/logs 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:17.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:17.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:17.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.841404 31557 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:17.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.842623 31557 hybrid_clock.cc:181] HybridClock initialized: now 1573720157842589 us; error 42 us; skew 500 ppm 08:29:17.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.843158 31557 fs_manager.cc:261] Metadata directory not provided 08:29:17.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.843214 31557 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:17.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.843508 31557 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:17.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.843544 31557 server_base.cc:453] Attempting to create new FS layout instead 08:29:17.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.845576 31557 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/data/instance: 08:29:17.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e731e0dbd90c4b498472b83f926563e4" 08:29:17.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:17 on dist-test-slave-dist-test-slave-05kx" 08:29:17.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.845965 31557 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/wal/instance: 08:29:17.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e731e0dbd90c4b498472b83f926563e4" 08:29:17.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:17 on dist-test-slave-dist-test-slave-05kx" 08:29:17.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.852946 31556 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } attempt: 2 08:29:17.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.852955 31557 fs_manager.cc:508] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s 08:29:17.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.853736 31557 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:17.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.854125 31556 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.191.61:43515: Network error: Client connection negotiation failed: client connection to 127.30.191.61:43515: connect: Connection refused (error 111) 08:29:17.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.854281 31557 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.857295 31557 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.857386 31557 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/wal 08:29:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "e731e0dbd90c4b498472b83f926563e4" 08:29:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:17 on dist-test-slave-dist-test-slave-05kx" 08:29:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.857473 31557 fs_report.cc:352] FS layout report 08:29:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/wal 08:29:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/wal 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/data/data 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:17.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:17.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.924839 31557 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:17.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.930572 31557 rpc_server.cc:211] RPC server started. Bound to: 127.30.191.61:43515 08:29:17.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.931407 31557 webserver.cc:382] Webserver started at http://127.30.191.61:40577/ using document root and password file 08:29:17.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.931969 31557 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-1/data/info.pb 08:29:17.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.934612 31621 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.937954 31621 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } has no permanent_uuid. Determining permanent_uuid... 08:29:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.938850 31484 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 31557 08:29:17.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.939453 31484 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:17.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:17.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/wal 08:29:17.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/data 08:29:17.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:17.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:17.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.60:38723 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.60 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/logs 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/data/info.pb 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:17.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:17.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:17.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:17.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:17.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:17.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:17.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:17.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:17.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.948900 31621 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } has no permanent_uuid. Determining permanent_uuid... 08:29:17.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.955793 31621 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } has no permanent_uuid. Determining permanent_uuid... 08:29:17.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.956578 31621 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.191.60:38723: Network error: Client connection negotiation failed: client connection to 127.30.191.60:38723: connect: Connection refused (error 111) 08:29:17.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.965342 31556 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } attempt: 3 08:29:17.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.969949 31556 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } has no permanent_uuid. Determining permanent_uuid... 08:29:17.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.970688 31556 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.191.60:38723: Network error: Client connection negotiation failed: client connection to 127.30.191.60:38723: connect: Connection refused (error 111) 08:29:17.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:17.975811 31621 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } attempt: 1 08:29:17.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:17.976572 31621 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.191.60:38723: Network error: Client connection negotiation failed: client connection to 127.30.191.60:38723: connect: Connection refused (error 111) 08:29:18.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:18.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.008476 31623 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.008695 31623 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.009675 31623 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.009704 31623 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.009712 31623 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.009721 31623 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:18.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.011500 31623 master_main.cc:98] Master server non-default flags: 08:29:18.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:18.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:18.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:18.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:18.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/data 08:29:18.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/wal 08:29:18.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.60:38723 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/data/info.pb 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.60 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.31623 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/logs 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:18.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.019254 31623 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:18.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.020421 31623 hybrid_clock.cc:181] HybridClock initialized: now 1573720158020364 us; error 63 us; skew 500 ppm 08:29:18.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.020967 31623 fs_manager.cc:261] Metadata directory not provided 08:29:18.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.021037 31623 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:18.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.021303 31623 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:18.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.021335 31623 server_base.cc:453] Attempting to create new FS layout instead 08:29:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.023325 31623 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/data/instance: 08:29:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "f4fa1a8638174aa49ee744e4cdfb5947" 08:29:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.023566 31623 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/wal/instance: 08:29:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "f4fa1a8638174aa49ee744e4cdfb5947" 08:29:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.024754 31621 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } attempt: 2 08:29:18.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.025858 31621 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.191.60:38723: Network error: Client connection negotiation failed: client connection to 127.30.191.60:38723: connect: Connection refused (error 111) 08:29:18.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.029506 31623 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s 08:29:18.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.030699 31623 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:18.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.031306 31623 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:18.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.034873 31556 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } attempt: 1 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.035990 31556 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.30.191.60:38723: Network error: Client connection negotiation failed: client connection to 127.30.191.60:38723: connect: Connection refused (error 111) 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.036152 31623 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.036259 31623 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/wal 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "f4fa1a8638174aa49ee744e4cdfb5947" 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.036382 31623 fs_report.cc:352] FS layout report 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/wal 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/wal 08:29:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/data/data 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:18.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:18.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.074666 31623 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:18.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.080706 31623 rpc_server.cc:211] RPC server started. Bound to: 127.30.191.60:38723 08:29:18.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.081665 31623 webserver.cc:382] Webserver started at http://127.30.191.60:39515/ using document root and password file 08:29:18.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.082262 31623 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/master-2/data/info.pb 08:29:18.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.084882 31685 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:18.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.088418 31685 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } has no permanent_uuid. Determining permanent_uuid... 08:29:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.089015 31484 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 31623 08:29:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.089670 31484 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/wal 08:29:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/data 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.1:0 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.191.1 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.1 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/logs 08:29:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/data/info.pb 08:29:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:18.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.097460 31685 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } has no permanent_uuid. Determining permanent_uuid... 08:29:18.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.101238 31685 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } has no permanent_uuid. Determining permanent_uuid... 08:29:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.108315 31685 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947: Bootstrap starting. 08:29:18.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.110110 31685 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947: No blocks or log segments found. Creating new log. 08:29:18.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.110836 31685 log.cc:558] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947: Log is configured to *not* fsync() on all Append() calls 08:29:18.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.112443 31685 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947: No bootstrap required, opened a new log 08:29:18.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.115242 31556 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } attempt: 2 08:29:18.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.116127 31685 raft_consensus.cc:333] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.116245 31685 raft_consensus.cc:359] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:18.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.116298 31685 raft_consensus.cc:698] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4fa1a8638174aa49ee744e4cdfb5947, State: Initialized, Role: FOLLOWER 08:29:18.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.116924 31685 consensus_queue.cc:228] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.117523 31685 sys_catalog.cc:340] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.117568 31685 sys_catalog.cc:343] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.118376 31690 sys_catalog.cc:340] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.118556 31690 sys_catalog.cc:343] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.118598 31685 sys_catalog.cc:428] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: configured and running, proceeding with master startup. 08:29:18.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.121932 31556 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467: Bootstrap starting. 08:29:18.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.122277 31691 catalog_manager.cc:1159] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:18.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.122318 31691 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:18.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.124135 31556 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467: No blocks or log segments found. Creating new log. 08:29:18.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.125154 31556 log.cc:558] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467: Log is configured to *not* fsync() on all Append() calls 08:29:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.129948 31556 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467: No bootstrap required, opened a new log 08:29:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.133365 31556 raft_consensus.cc:333] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.133462 31556 raft_consensus.cc:359] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.133505 31556 raft_consensus.cc:698] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46ce17726154405c80be7f007b0e9467, State: Initialized, Role: FOLLOWER 08:29:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.134061 31556 consensus_queue.cc:228] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.134452 31556 sys_catalog.cc:340] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.134497 31556 sys_catalog.cc:343] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.135429 31556 sys_catalog.cc:428] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: configured and running, proceeding with master startup. 08:29:18.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.136988 31694 sys_catalog.cc:340] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.137029 31694 sys_catalog.cc:343] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.137049 31621 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } attempt: 3 08:29:18.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.139573 31695 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:18.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.139611 31695 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.143970 31621 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4: Bootstrap starting. 08:29:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.146296 31686 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.146450 31621 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4: No blocks or log segments found. Creating new log. 08:29:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.146482 31686 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.147300 31686 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.147346 31686 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.191.1 08:29:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.147461 31621 log.cc:558] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4: Log is configured to *not* fsync() on all Append() calls 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.148923 31686 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/data 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/wal 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.1:0 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/data/info.pb 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.1 08:29:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.31686 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.191.1 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/logs 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:18.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:18.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:18.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:18.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.150328 31621 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4: No bootstrap required, opened a new log 08:29:18.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.154070 31621 raft_consensus.cc:333] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.154170 31621 raft_consensus.cc:359] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:18.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.154219 31621 raft_consensus.cc:698] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e731e0dbd90c4b498472b83f926563e4, State: Initialized, Role: FOLLOWER 08:29:18.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.154870 31621 consensus_queue.cc:228] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.155278 31621 sys_catalog.cc:340] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.155320 31621 sys_catalog.cc:343] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.156338 31621 sys_catalog.cc:428] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: configured and running, proceeding with master startup. 08:29:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.159139 31686 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.159718 31702 catalog_manager.cc:1159] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.159756 31702 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:18.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.162433 31686 hybrid_clock.cc:181] HybridClock initialized: now 1573720158162385 us; error 54 us; skew 500 ppm 08:29:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.163028 31686 fs_manager.cc:261] Metadata directory not provided 08:29:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.163075 31686 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.163331 31686 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.163362 31686 server_base.cc:453] Attempting to create new FS layout instead 08:29:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.165146 31701 sys_catalog.cc:340] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.165203 31701 sys_catalog.cc:343] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.165406 31686 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/data/instance: 08:29:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ed61c27aa829404d8500d865f90ebbbe" 08:29:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.165669 31686 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/wal/instance: 08:29:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ed61c27aa829404d8500d865f90ebbbe" 08:29:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.174504 31686 fs_manager.cc:508] Time spent creating directory manager: real 0.009s user 0.004s sys 0.000s 08:29:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.175137 31686 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.175531 31686 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:18.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.176151 31576 tablet.cc:1764] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.178740 31686 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.178835 31686 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/wal 08:29:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ed61c27aa829404d8500d865f90ebbbe" 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.178912 31686 fs_report.cc:352] FS layout report 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/wal 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/wal 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/data/data 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:18.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:18.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:18.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:18.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.225397 31686 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:18.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.226588 31686 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:18.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.226620 31686 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:18.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.233984 31686 rpc_server.cc:211] RPC server started. Bound to: 127.30.191.1:35683 08:29:18.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.234791 31686 webserver.cc:382] Webserver started at http://127.30.191.1:42195/ using document root and password file 08:29:18.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.235287 31686 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-0/data/info.pb 08:29:18.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.245035 31484 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 31686 08:29:18.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.245573 31484 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:18.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:18.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/wal 08:29:18.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/data 08:29:18.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:18.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.2:0 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.191.2 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.2 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/logs 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/data/info.pb 08:29:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:18.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.251891 31822 heartbeater.cc:322] Connected to a master server at 127.30.191.60:38723 08:29:18.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.252066 31822 heartbeater.cc:406] Registering TS with master... 08:29:18.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.252159 31824 heartbeater.cc:322] Connected to a master server at 127.30.191.62:35879 08:29:18.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.252234 31824 heartbeater.cc:406] Registering TS with master... 08:29:18.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.252450 31822 heartbeater.cc:455] Master 127.30.191.60:38723 requested a full tablet report, sending... 08:29:18.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.252457 31824 heartbeater.cc:455] Master 127.30.191.62:35879 requested a full tablet report, sending... 08:29:18.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.254038 31520 ts_manager.cc:191] Registered new tserver with Master: ed61c27aa829404d8500d865f90ebbbe (127.30.191.1:35683) 08:29:18.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.255030 31652 ts_manager.cc:191] Registered new tserver with Master: ed61c27aa829404d8500d865f90ebbbe (127.30.191.1:35683) 08:29:18.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.256722 31823 heartbeater.cc:322] Connected to a master server at 127.30.191.61:43515 08:29:18.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.256822 31823 heartbeater.cc:406] Registering TS with master... 08:29:18.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.257021 31823 heartbeater.cc:455] Master 127.30.191.61:43515 requested a full tablet report, sending... 08:29:18.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.258296 31587 ts_manager.cc:191] Registered new tserver with Master: ed61c27aa829404d8500d865f90ebbbe (127.30.191.1:35683) 08:29:18.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.262007 31510 tablet.cc:1764] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:18.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.326251 31641 tablet.cc:1764] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:18.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.406528 31690 raft_consensus.cc:465] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:18.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.406786 31690 raft_consensus.cc:487] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.408119 31690 leader_election.cc:296] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46ce17726154405c80be7f007b0e9467 (127.30.191.62:35879), e731e0dbd90c4b498472b83f926563e4 (127.30.191.61:43515) 08:29:18.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.408392 31701 raft_consensus.cc:465] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:18.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.408560 31701 raft_consensus.cc:487] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.409126 31597 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e731e0dbd90c4b498472b83f926563e4" is_pre_election: true 08:29:18.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.409332 31597 raft_consensus.cc:2355] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4fa1a8638174aa49ee744e4cdfb5947 in term 0. 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.409343 31532 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46ce17726154405c80be7f007b0e9467" is_pre_election: true 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.409504 31701 leader_election.cc:296] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46ce17726154405c80be7f007b0e9467 (127.30.191.62:35879), f4fa1a8638174aa49ee744e4cdfb5947 (127.30.191.60:38723) 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.409587 31532 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4fa1a8638174aa49ee744e4cdfb5947 in term 0. 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.410181 31635 leader_election.cc:310] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46ce17726154405c80be7f007b0e9467, f4fa1a8638174aa49ee744e4cdfb5947; no voters: 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.410241 31532 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e731e0dbd90c4b498472b83f926563e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46ce17726154405c80be7f007b0e9467" is_pre_election: true 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.410311 31532 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e731e0dbd90c4b498472b83f926563e4 in term 0. 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.410755 31570 leader_election.cc:310] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46ce17726154405c80be7f007b0e9467, e731e0dbd90c4b498472b83f926563e4; no voters: 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.411085 31701 raft_consensus.cc:2649] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.411077 31659 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e731e0dbd90c4b498472b83f926563e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" is_pre_election: true 08:29:18.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.411134 31701 raft_consensus.cc:465] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:18.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.411161 31701 raft_consensus.cc:2901] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 0 FOLLOWER]: Advancing to term 1 08:29:18.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.411234 31659 raft_consensus.cc:2355] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e731e0dbd90c4b498472b83f926563e4 in term 0. 08:29:18.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.412590 31701 raft_consensus.cc:487] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.412971 31701 leader_election.cc:296] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [CANDIDATE]: Term 1 election: Requested vote from peers 46ce17726154405c80be7f007b0e9467 (127.30.191.62:35879), f4fa1a8638174aa49ee744e4cdfb5947 (127.30.191.60:38723) 08:29:18.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.413542 31532 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e731e0dbd90c4b498472b83f926563e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46ce17726154405c80be7f007b0e9467" 08:29:18.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.413552 31659 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e731e0dbd90c4b498472b83f926563e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.413600 31532 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [term 0 FOLLOWER]: Advancing to term 1 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.413604 31659 raft_consensus.cc:2901] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 0 FOLLOWER]: Advancing to term 1 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.414742 31532 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e731e0dbd90c4b498472b83f926563e4 in term 1. 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.414742 31659 raft_consensus.cc:2355] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e731e0dbd90c4b498472b83f926563e4 in term 1. 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.415047 31570 leader_election.cc:310] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46ce17726154405c80be7f007b0e9467, e731e0dbd90c4b498472b83f926563e4; no voters: 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.415235 31701 raft_consensus.cc:2649] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 1 FOLLOWER]: Leader election won for term 1 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.415391 31690 raft_consensus.cc:2612] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.415482 31701 raft_consensus.cc:660] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [term 1 LEADER]: Becoming Leader. State: Replica: e731e0dbd90c4b498472b83f926563e4, State: Running, Role: LEADER 08:29:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.415889 31701 consensus_queue.cc:205] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } 08:29:18.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.421293 31830 sys_catalog.cc:340] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e731e0dbd90c4b498472b83f926563e4. Latest consensus state: current_term: 1 leader_uuid: "e731e0dbd90c4b498472b83f926563e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.421329 31830 sys_catalog.cc:343] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: This master's current role is: LEADER 08:29:18.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.422742 31832 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:18.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.423956 31832 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:18.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:18.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.435348 31829 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:18.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.435604 31829 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:18.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.436906 31829 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:18.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.437002 31829 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.191.2 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.439344 31829 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/data 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/wal 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.2:0 08:29:18.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/data/info.pb 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.2 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.31829 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.191.2 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/logs 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:18.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.449393 31829 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:18.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.465004 31829 hybrid_clock.cc:181] HybridClock initialized: now 1573720158464927 us; error 65 us; skew 500 ppm 08:29:18.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.465620 31829 fs_manager.cc:261] Metadata directory not provided 08:29:18.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.465667 31829 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:18.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.465893 31829 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:18.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.465921 31829 server_base.cc:453] Attempting to create new FS layout instead 08:29:18.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.467775 31829 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/data/instance: 08:29:18.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "356215da9c2c4062b2a34285b4e95fbf" 08:29:18.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.468029 31829 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/wal/instance: 08:29:18.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "356215da9c2c4062b2a34285b4e95fbf" 08:29:18.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.472837 31829 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s 08:29:18.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.473752 31829 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:18.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.474246 31829 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:18.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.474541 31659 raft_consensus.cc:1177] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [term 1 FOLLOWER]: Refusing update from remote peer e731e0dbd90c4b498472b83f926563e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:18.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.474782 31532 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [term 1 FOLLOWER]: Refusing update from remote peer e731e0dbd90c4b498472b83f926563e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:18.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.475378 31701 consensus_queue.cc:981] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:18.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.475505 31830 consensus_queue.cc:981] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:18.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.477644 31829 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s 08:29:18.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.477759 31829 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/wal 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "356215da9c2c4062b2a34285b4e95fbf" 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.477988 31829 fs_report.cc:352] FS layout report 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/wal 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/wal 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/data/data 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:18.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:18.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:18.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.480015 31690 sys_catalog.cc:340] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e731e0dbd90c4b498472b83f926563e4. Latest consensus state: current_term: 1 leader_uuid: "e731e0dbd90c4b498472b83f926563e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.480067 31690 sys_catalog.cc:343] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.480741 31694 sys_catalog.cc:340] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e731e0dbd90c4b498472b83f926563e4. Latest consensus state: current_term: 1 leader_uuid: "e731e0dbd90c4b498472b83f926563e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.480823 31694 sys_catalog.cc:343] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.483247 31830 sys_catalog.cc:340] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e731e0dbd90c4b498472b83f926563e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.483281 31830 sys_catalog.cc:343] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: This master's current role is: LEADER 08:29:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.483631 31838 mvcc.cc:203] Tried to move safe_time back from 6445957769101996032 to 6445957768873947136. Current Snapshot: MvccSnapshot[committed={T|T < 6445957769101996032}] 08:29:18.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.484318 31694 sys_catalog.cc:340] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e731e0dbd90c4b498472b83f926563e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.484349 31694 sys_catalog.cc:343] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.484401 31832 catalog_manager.cc:985] Generated new certificate authority record 08:29:18.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.485658 31842 mvcc.cc:203] Tried to move safe_time back from 6445957769101996032 to 6445957768873947136. Current Snapshot: MvccSnapshot[committed={T|T < 6445957769101996032 or (T in {6445957769101996032})}] 08:29:18.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.485971 31832 catalog_manager.cc:1110] Loading token signing keys... 08:29:18.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.489840 31830 sys_catalog.cc:340] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e731e0dbd90c4b498472b83f926563e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.489871 31830 sys_catalog.cc:343] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4 [sys.catalog]: This master's current role is: LEADER 08:29:18.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.491010 31690 sys_catalog.cc:340] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e731e0dbd90c4b498472b83f926563e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46ce17726154405c80be7f007b0e9467" member_type: VOTER last_known_addr { host: "127.30.191.62" port: 35879 } } peers { permanent_uuid: "e731e0dbd90c4b498472b83f926563e4" member_type: VOTER last_known_addr { host: "127.30.191.61" port: 43515 } } peers { permanent_uuid: "f4fa1a8638174aa49ee744e4cdfb5947" member_type: VOTER last_known_addr { host: "127.30.191.60" port: 38723 } } } 08:29:18.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.491044 31690 sys_catalog.cc:343] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947 [sys.catalog]: This master's current role is: FOLLOWER 08:29:18.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.495913 31832 catalog_manager.cc:4455] T 00000000000000000000000000000000 P e731e0dbd90c4b498472b83f926563e4: Generated new TSK 0 08:29:18.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.496436 31832 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:18.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.513586 31829 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.514793 31829 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.514823 31829 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:18.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.522480 31829 rpc_server.cc:211] RPC server started. Bound to: 127.30.191.2:41317 08:29:18.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.523305 31829 webserver.cc:382] Webserver started at http://127.30.191.2:39401/ using document root and password file 08:29:18.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.523813 31829 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-1/data/info.pb 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.528594 31484 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 31829 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.529158 31484 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/wal 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/data 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.3:0 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.191.3 08:29:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.3 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/logs 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/data/info.pb 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:18.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:18.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:18.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:18.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.533479 31964 heartbeater.cc:322] Connected to a master server at 127.30.191.61:43515 08:29:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.533551 31962 heartbeater.cc:322] Connected to a master server at 127.30.191.60:38723 08:29:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.533628 31962 heartbeater.cc:406] Registering TS with master... 08:29:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.533629 31964 heartbeater.cc:406] Registering TS with master... 08:29:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.534162 31964 heartbeater.cc:455] Master 127.30.191.61:43515 requested a full tablet report, sending... 08:29:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.534302 31962 heartbeater.cc:455] Master 127.30.191.60:38723 requested a full tablet report, sending... 08:29:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.534873 31965 heartbeater.cc:322] Connected to a master server at 127.30.191.62:35879 08:29:18.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.534915 31965 heartbeater.cc:406] Registering TS with master... 08:29:18.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.535060 31965 heartbeater.cc:455] Master 127.30.191.62:35879 requested a full tablet report, sending... 08:29:18.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.535214 31587 ts_manager.cc:191] Registered new tserver with Master: 356215da9c2c4062b2a34285b4e95fbf (127.30.191.2:41317) 08:29:18.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.535658 31652 ts_manager.cc:191] Registered new tserver with Master: 356215da9c2c4062b2a34285b4e95fbf (127.30.191.2:41317) 08:29:18.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.536607 31520 ts_manager.cc:191] Registered new tserver with Master: 356215da9c2c4062b2a34285b4e95fbf (127.30.191.2:41317) 08:29:18.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.536875 31587 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.30.191.2:49741 08:29:18.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:18.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.580763 31970 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:18.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.581022 31970 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:18.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.581825 31970 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:18.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.581882 31970 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.191.3 08:29:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.583451 31970 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.30.191.20:38265 08:29:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/data 08:29:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/wal 08:29:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.30.191.3:0 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/data/info.pb 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.30.191.3 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.30.191.62:35879,127.30.191.61:43515,127.30.191.60:38723 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.31970 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.30.191.3 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/logs 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:18.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:18.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.591135 31970 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:18.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.592293 31970 hybrid_clock.cc:181] HybridClock initialized: now 1573720158592257 us; error 41 us; skew 500 ppm 08:29:18.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.592836 31970 fs_manager.cc:261] Metadata directory not provided 08:29:18.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.592890 31970 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:18.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.593101 31970 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:18.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.593127 31970 server_base.cc:453] Attempting to create new FS layout instead 08:29:18.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.595057 31970 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/data/instance: 08:29:18.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ce1e0eef10cb4630ade5c95d9843dae9" 08:29:18.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.595289 31970 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/wal/instance: 08:29:18.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ce1e0eef10cb4630ade5c95d9843dae9" 08:29:18.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.600245 31970 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s 08:29:18.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.601065 31970 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:18.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.601533 31970 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.604461 31970 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.604565 31970 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/wal 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "ce1e0eef10cb4630ade5c95d9843dae9" 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:18 on dist-test-slave-dist-test-slave-05kx" 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.604638 31970 fs_report.cc:352] FS layout report 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/wal 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/wal 08:29:18.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/data/data 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:18.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.662892 31970 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:18.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.663986 31970 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:18.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.664016 31970 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:18.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.671017 31970 rpc_server.cc:211] RPC server started. Bound to: 127.30.191.3:46195 08:29:18.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.671778 31970 webserver.cc:382] Webserver started at http://127.30.191.3:39971/ using document root and password file 08:29:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.672230 31970 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1093220606982246221/ts-2/data/info.pb 08:29:18.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.675966 31484 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 31970 08:29:18.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.684406 32094 heartbeater.cc:322] Connected to a master server at 127.30.191.62:35879 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.684543 32094 heartbeater.cc:406] Registering TS with master... 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.684424 32092 heartbeater.cc:322] Connected to a master server at 127.30.191.60:38723 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.684849 32092 heartbeater.cc:406] Registering TS with master... 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.685170 32092 heartbeater.cc:455] Master 127.30.191.60:38723 requested a full tablet report, sending... 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.685216 32094 heartbeater.cc:455] Master 127.30.191.62:35879 requested a full tablet report, sending... 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.686317 31652 ts_manager.cc:191] Registered new tserver with Master: ce1e0eef10cb4630ade5c95d9843dae9 (127.30.191.3:46195) 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.686372 32093 heartbeater.cc:322] Connected to a master server at 127.30.191.61:43515 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.686411 32093 heartbeater.cc:406] Registering TS with master... 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.686448 31520 ts_manager.cc:191] Registered new tserver with Master: ce1e0eef10cb4630ade5c95d9843dae9 (127.30.191.3:46195) 08:29:18.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.686558 32093 heartbeater.cc:455] Master 127.30.191.61:43515 requested a full tablet report, sending... 08:29:18.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.687255 31587 ts_manager.cc:191] Registered new tserver with Master: ce1e0eef10cb4630ade5c95d9843dae9 (127.30.191.3:46195) 08:29:18.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.688217 31587 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.30.191.3:38685 08:29:18.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.697556 31484 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:18.697 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:18.698 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:18.698 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.30.191.62" port: 35879 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.30.191.61" port: 43515 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.30.191.60" port: 38723 } } } 08:29:18.699 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:18.699 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.30.191.1" port: 35683 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.30.191.2" port: 41317 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.30.191.3" port: 46195 } } } 08:29:18.700 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:18.704 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:18.708 [DEBUG - New I/O worker #55] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.30.191.60 08:29:18.708 [DEBUG - New I/O worker #56] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.30.191.62 08:29:18.709 [DEBUG - New I/O worker #57] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.30.191.61 08:29:18.716 [DEBUG - New I/O worker #56] (Negotiator.java:764) Authenticated connection [id: 0xde68d2ff, /127.0.0.1:35834 => /127.30.191.62:35879] using SASL/PLAIN 08:29:18.716 [DEBUG - New I/O worker #57] (Negotiator.java:764) Authenticated connection [id: 0x955f8a9e, /127.0.0.1:48532 => /127.30.191.61:43515] using SASL/PLAIN 08:29:18.716 [DEBUG - New I/O worker #55] (Negotiator.java:764) Authenticated connection [id: 0x7b990164, /127.0.0.1:36888 => /127.30.191.60:38723] using SASL/PLAIN 08:29:18.720 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:18.721 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=16), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.191.60:38723, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.191.62:35879, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.191.61:43515, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.191.60:38723: OK, [16ms] Sub RPC ConnectToMaster: received response from server master-127.30.191.62:35879: OK, [16ms] Sub RPC ConnectToMaster: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.725193 31587 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48532: 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:18.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.726370 31587 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:18.737 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:777) Opened table a6658b673f944de0a83d2ccc770965ee 08:29:18.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.746536 32028 tablet_service.cc:1023] Processing CreateTablet for tablet cf4eaad7f2244671b3d1dfccf7824965 (table=org.apache.kudu.client.TestAsyncKuduSession [id=a6658b673f944de0a83d2ccc770965ee]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:18.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.746645 31749 tablet_service.cc:1023] Processing CreateTablet for tablet cf4eaad7f2244671b3d1dfccf7824965 (table=org.apache.kudu.client.TestAsyncKuduSession [id=a6658b673f944de0a83d2ccc770965ee]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.747184 32028 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet cf4eaad7f2244671b3d1dfccf7824965. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.747184 31749 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet cf4eaad7f2244671b3d1dfccf7824965. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.747720 31899 tablet_service.cc:1023] Processing CreateTablet for tablet cf4eaad7f2244671b3d1dfccf7824965 (table=org.apache.kudu.client.TestAsyncKuduSession [id=a6658b673f944de0a83d2ccc770965ee]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:18.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.748214 31899 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet cf4eaad7f2244671b3d1dfccf7824965. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.754256 32117 tablet_bootstrap.cc:439] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe: Bootstrap starting. 08:29:18.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.755729 32117 tablet_bootstrap.cc:590] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe: No blocks or log segments found. Creating new log. 08:29:18.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.756450 32117 log.cc:558] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe: Log is configured to *not* fsync() on all Append() calls 08:29:18.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.757084 32118 tablet_bootstrap.cc:439] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9: Bootstrap starting. 08:29:18.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.758309 32118 tablet_bootstrap.cc:590] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9: No blocks or log segments found. Creating new log. 08:29:18.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.758896 32118 log.cc:558] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9: Log is configured to *not* fsync() on all Append() calls 08:29:18.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.759467 32119 tablet_bootstrap.cc:439] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf: Bootstrap starting. 08:29:18.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.760728 32119 tablet_bootstrap.cc:590] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf: No blocks or log segments found. Creating new log. 08:29:18.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.761744 32119 log.cc:558] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf: Log is configured to *not* fsync() on all Append() calls 08:29:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.763362 32117 tablet_bootstrap.cc:439] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe: No bootstrap required, opened a new log 08:29:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.763398 32119 tablet_bootstrap.cc:439] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf: No bootstrap required, opened a new log 08:29:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.763607 32118 tablet_bootstrap.cc:439] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9: No bootstrap required, opened a new log 08:29:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.763619 32119 ts_tablet_manager.cc:1096] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s 08:29:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.763772 32117 ts_tablet_manager.cc:1096] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s 08:29:18.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.764183 32118 ts_tablet_manager.cc:1096] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s 08:29:18.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.766713 32117 raft_consensus.cc:333] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:18.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.766893 32119 raft_consensus.cc:333] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.766963 32117 raft_consensus.cc:359] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.766999 32117 raft_consensus.cc:698] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed61c27aa829404d8500d865f90ebbbe, State: Initialized, Role: FOLLOWER 08:29:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.767067 32118 raft_consensus.cc:333] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.767143 32118 raft_consensus.cc:359] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.767177 32118 raft_consensus.cc:698] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1e0eef10cb4630ade5c95d9843dae9, State: Initialized, Role: FOLLOWER 08:29:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.767465 32117 consensus_queue.cc:228] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.767648 32119 raft_consensus.cc:359] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.767655 32118 consensus_queue.cc:228] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:18.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.768227 32119 raft_consensus.cc:698] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356215da9c2c4062b2a34285b4e95fbf, State: Initialized, Role: FOLLOWER 08:29:18.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.768630 32093 heartbeater.cc:447] Master 127.30.191.61:43515 was elected leader, sending a full tablet report... 08:29:18.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.771492 32119 consensus_queue.cc:228] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:18.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.773639 31964 heartbeater.cc:447] Master 127.30.191.61:43515 was elected leader, sending a full tablet report... 08:29:18.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.774068 31586 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.30.191.1:59929 08:29:18.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.774994 32118 ts_tablet_manager.cc:1124] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s 08:29:18.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.775283 32119 ts_tablet_manager.cc:1124] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s 08:29:18.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.775524 31966 tablet.cc:1764] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:18.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.776676 32117 ts_tablet_manager.cc:1124] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s 08:29:18.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:18.777117 31823 heartbeater.cc:447] Master 127.30.191.61:43515 was elected leader, sending a full tablet report... 08:29:18.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.924515 32095 tablet.cc:1764] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:18.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:18.988910 31825 tablet.cc:1764] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:19.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.063616 32123 raft_consensus.cc:465] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:19.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.063820 32123 raft_consensus.cc:487] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:19.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.064846 32123 leader_election.cc:296] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1e0eef10cb4630ade5c95d9843dae9 (127.30.191.3:46195), 356215da9c2c4062b2a34285b4e95fbf (127.30.191.2:41317) 08:29:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.069206 32049 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "cf4eaad7f2244671b3d1dfccf7824965" candidate_uuid: "ed61c27aa829404d8500d865f90ebbbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" is_pre_election: true 08:29:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.069358 31919 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "cf4eaad7f2244671b3d1dfccf7824965" candidate_uuid: "ed61c27aa829404d8500d865f90ebbbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356215da9c2c4062b2a34285b4e95fbf" is_pre_election: true 08:29:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.069422 32049 raft_consensus.cc:2355] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed61c27aa829404d8500d865f90ebbbe in term 0. 08:29:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.069514 31919 raft_consensus.cc:2355] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed61c27aa829404d8500d865f90ebbbe in term 0. 08:29:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.069967 31711 leader_election.cc:310] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1e0eef10cb4630ade5c95d9843dae9, ed61c27aa829404d8500d865f90ebbbe; no voters: 08:29:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.070255 32123 raft_consensus.cc:2649] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.070318 32123 raft_consensus.cc:465] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.070343 32123 raft_consensus.cc:2901] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 0 FOLLOWER]: Advancing to term 1 08:29:19.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.071324 32123 raft_consensus.cc:487] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:19.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.071647 32123 leader_election.cc:296] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [CANDIDATE]: Term 1 election: Requested vote from peers ce1e0eef10cb4630ade5c95d9843dae9 (127.30.191.3:46195), 356215da9c2c4062b2a34285b4e95fbf (127.30.191.2:41317) 08:29:19.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.072135 32049 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "cf4eaad7f2244671b3d1dfccf7824965" candidate_uuid: "ed61c27aa829404d8500d865f90ebbbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" 08:29:19.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.072192 31919 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "cf4eaad7f2244671b3d1dfccf7824965" candidate_uuid: "ed61c27aa829404d8500d865f90ebbbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "356215da9c2c4062b2a34285b4e95fbf" 08:29:19.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.072219 32049 raft_consensus.cc:2901] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9 [term 0 FOLLOWER]: Advancing to term 1 08:29:19.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.072252 31919 raft_consensus.cc:2901] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf [term 0 FOLLOWER]: Advancing to term 1 08:29:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.073132 31919 raft_consensus.cc:2355] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed61c27aa829404d8500d865f90ebbbe in term 1. 08:29:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.073206 32049 raft_consensus.cc:2355] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed61c27aa829404d8500d865f90ebbbe in term 1. 08:29:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.073487 31711 leader_election.cc:310] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356215da9c2c4062b2a34285b4e95fbf, ed61c27aa829404d8500d865f90ebbbe; no voters: 08:29:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.073680 32123 raft_consensus.cc:2649] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 1 FOLLOWER]: Leader election won for term 1 08:29:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.073909 32123 raft_consensus.cc:660] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [term 1 LEADER]: Becoming Leader. State: Replica: ed61c27aa829404d8500d865f90ebbbe, State: Running, Role: LEADER 08:29:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.074252 32123 consensus_queue.cc:205] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } } 08:29:19.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.077893 31587 catalog_manager.cc:4143] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe reported cstate change: term changed from 0 to 1, leader changed from to ed61c27aa829404d8500d865f90ebbbe (127.30.191.1). New cstate: current_term: 1 leader_uuid: "ed61c27aa829404d8500d865f90ebbbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed61c27aa829404d8500d865f90ebbbe" member_type: VOTER last_known_addr { host: "127.30.191.1" port: 35683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 } health_report { overall_health: UNKNOWN } } } 08:29:19.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.125834 31691 catalog_manager.cc:1157] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947: acquiring CA information for follower catalog manager: success 08:29:19.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.127099 31691 catalog_manager.cc:1185] T 00000000000000000000000000000000 P f4fa1a8638174aa49ee744e4cdfb5947: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:19.131 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet cf4eaad7f2244671b3d1dfccf7824965 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:19.132 [DEBUG - New I/O worker #57] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=cf4eaad7f2244671b3d1dfccf7824965@[356215da9c2c4062b2a34285b4e95fbf(127.30.191.2:41317),ce1e0eef10cb4630ade5c95d9843dae9(127.30.191.3:46195),ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)[L]]}] 08:29:19.132 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.191.61:43515, [2ms] Sub RPC GetTableLocations: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:19.137 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet cf4eaad7f2244671b3d1dfccf7824965 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:19.138 [DEBUG - New I/O worker #57] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=cf4eaad7f2244671b3d1dfccf7824965@[356215da9c2c4062b2a34285b4e95fbf(127.30.191.2:41317),ce1e0eef10cb4630ade5c95d9843dae9(127.30.191.3:46195),ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)[L]]}] 08:29:19.138 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=9), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.191.61:43515, [8ms] Sub RPC GetTableLocations: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:19.139 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet cf4eaad7f2244671b3d1dfccf7824965 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:19.139 [DEBUG - New I/O worker #57] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=cf4eaad7f2244671b3d1dfccf7824965@[356215da9c2c4062b2a34285b4e95fbf(127.30.191.2:41317),ce1e0eef10cb4630ade5c95d9843dae9(127.30.191.3:46195),ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)[L]]}] 08:29:19.139 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=11), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.191.61:43515, [10ms] Sub RPC GetTableLocations: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:19.140 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet cf4eaad7f2244671b3d1dfccf7824965 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:19.140 [DEBUG - New I/O worker #57] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=cf4eaad7f2244671b3d1dfccf7824965@[356215da9c2c4062b2a34285b4e95fbf(127.30.191.2:41317),ce1e0eef10cb4630ade5c95d9843dae9(127.30.191.3:46195),ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)[L]]}] 08:29:19.140 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=11), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.191.61:43515, [11ms] Sub RPC GetTableLocations: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:19.141 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet cf4eaad7f2244671b3d1dfccf7824965 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:19.141 [DEBUG - New I/O worker #57] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=cf4eaad7f2244671b3d1dfccf7824965@[356215da9c2c4062b2a34285b4e95fbf(127.30.191.2:41317),ce1e0eef10cb4630ade5c95d9843dae9(127.30.191.3:46195),ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)[L]]}] 08:29:19.141 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=12), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.191.61:43515, [12ms] Sub RPC GetTableLocations: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:19.142 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet cf4eaad7f2244671b3d1dfccf7824965 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:19.142 [DEBUG - New I/O worker #57] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=cf4eaad7f2244671b3d1dfccf7824965@[356215da9c2c4062b2a34285b4e95fbf(127.30.191.2:41317),ce1e0eef10cb4630ade5c95d9843dae9(127.30.191.3:46195),ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)[L]]}] 08:29:19.143 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=13), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.191.61:43515, [13ms] Sub RPC GetTableLocations: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:19.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.143548 31695 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467: acquiring CA information for follower catalog manager: success 08:29:19.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.144605 31695 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 46ce17726154405c80be7f007b0e9467: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:19.147 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet cf4eaad7f2244671b3d1dfccf7824965 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:19.147 [DEBUG - New I/O worker #57] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=cf4eaad7f2244671b3d1dfccf7824965@[356215da9c2c4062b2a34285b4e95fbf(127.30.191.2:41317),ce1e0eef10cb4630ade5c95d9843dae9(127.30.191.3:46195),ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)[L]]}] 08:29:19.148 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=16), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.191.61:43515, [14ms] Sub RPC GetTableLocations: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:19.150 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:2346) Learned about tablet cf4eaad7f2244671b3d1dfccf7824965 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:19.150 [DEBUG - New I/O worker #57] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=cf4eaad7f2244671b3d1dfccf7824965@[356215da9c2c4062b2a34285b4e95fbf(127.30.191.2:41317),ce1e0eef10cb4630ade5c95d9843dae9(127.30.191.3:46195),ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)[L]]}] 08:29:19.150 [DEBUG - New I/O worker #57] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=18), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.191.61:43515, [17ms] Sub RPC GetTableLocations: received response from server master-127.30.191.61:43515: OK, deferred=null) after lookup 08:29:19.155 [DEBUG - New I/O worker #58] (Negotiator.java:764) Authenticated connection [id: 0x4217bbd3, /127.0.0.1:35320 => /127.30.191.1:35683] using TOKEN/null 08:29:19.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.186516 31919 raft_consensus.cc:1177] T cf4eaad7f2244671b3d1dfccf7824965 P 356215da9c2c4062b2a34285b4e95fbf [term 1 FOLLOWER]: Refusing update from remote peer ed61c27aa829404d8500d865f90ebbbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:19.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.188313 32123 consensus_queue.cc:981] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "356215da9c2c4062b2a34285b4e95fbf" member_type: VOTER last_known_addr { host: "127.30.191.2" port: 41317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:19.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.188318 32049 raft_consensus.cc:1177] T cf4eaad7f2244671b3d1dfccf7824965 P ce1e0eef10cb4630ade5c95d9843dae9 [term 1 FOLLOWER]: Refusing update from remote peer ed61c27aa829404d8500d865f90ebbbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:19.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.189028 32123 consensus_queue.cc:981] T cf4eaad7f2244671b3d1dfccf7824965 P ed61c27aa829404d8500d865f90ebbbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1e0eef10cb4630ade5c95d9843dae9" member_type: VOTER last_known_addr { host: "127.30.191.3" port: 46195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:19.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.206919 32132 mvcc.cc:203] Tried to move safe_time back from 6445957772025872384 to 6445957771569860608. Current Snapshot: MvccSnapshot[committed={T|T < 6445957771996880896}] 08:29:19.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.224035 32133 mvcc.cc:203] Tried to move safe_time back from 6445957772025872384 to 6445957771569860608. Current Snapshot: MvccSnapshot[committed={T|T < 6445957772025872384 or (T in {6445957772025872384})}] 08:29:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:19.425344 32131 mvcc.cc:203] Tried to move safe_time back from 6445957772974993408 to 6445957771569860608. Current Snapshot: MvccSnapshot[committed={T|T < 6445957772974993408 or (T in {6445957772974993408})}] 08:29:20.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.567734 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=793, attempt_no=1}) took 1001ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":324,"num_ops":1,"prepare.queue_time_us":979989,"prepare.run_cpu_time_us":472,"prepare.run_wall_time_us":472,"replication_time_us":9880,"spinlock_wait_cycles":23660288}]]} 08:29:20.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.567783 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=795, attempt_no=1}) took 1002ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":825,"num_ops":1,"prepare.queue_time_us":981125,"prepare.run_cpu_time_us":478,"prepare.run_wall_time_us":477,"replication_time_us":8783,"spinlock_wait_cycles":20170112}]]} 08:29:20.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.568393 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=791, attempt_no=1}) took 1007ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1359,"num_ops":1,"prepare.queue_time_us":981886,"prepare.run_cpu_time_us":450,"prepare.run_wall_time_us":459,"replication_time_us":7932,"spinlock_wait_cycles":25926400}]]} 08:29:20.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.569602 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=792, attempt_no=1}) took 1004ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1443,"num_ops":1,"prepare.queue_time_us":981512,"prepare.run_cpu_time_us":443,"prepare.run_wall_time_us":442,"replication_time_us":8353,"spinlock_wait_cycles":24942592}]]} 08:29:20.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.580752 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=845, attempt_no=1}) took 1002ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":47,"num_ops":1,"prepare.queue_time_us":995707,"prepare.run_cpu_time_us":365,"prepare.run_wall_time_us":364,"replication_time_us":5604}]]} 08:29:20.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.581226 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=846, attempt_no=1}) took 1002ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":439,"num_ops":1,"prepare.queue_time_us":996302,"prepare.run_cpu_time_us":430,"prepare.run_wall_time_us":428,"replication_time_us":4798}]]} 08:29:20.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.581682 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=848, attempt_no=1}) took 1002ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":825,"num_ops":1,"prepare.queue_time_us":996535,"prepare.run_cpu_time_us":419,"prepare.run_wall_time_us":417,"replication_time_us":4370}]]} 08:29:20.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.581795 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=844, attempt_no=1}) took 1002ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":172,"num_ops":1,"prepare.queue_time_us":996091,"prepare.run_cpu_time_us":429,"prepare.run_wall_time_us":479,"replication_time_us":5225}]]} 08:29:20.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.584601 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=839, attempt_no=1}) took 1007ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":141,"num_ops":1,"prepare.queue_time_us":996937,"prepare.run_cpu_time_us":486,"prepare.run_wall_time_us":855,"replication_time_us":7253,"spinlock_wait_cycles":385280}]]} 08:29:20.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.585086 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=849, attempt_no=1}) took 1005ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":610,"num_ops":1,"prepare.queue_time_us":997537,"prepare.run_cpu_time_us":617,"prepare.run_wall_time_us":2544,"replication_time_us":6631,"spinlock_wait_cycles":4380416}]]} 08:29:20.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.588551 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=847, attempt_no=1}) took 1009ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":254,"num_ops":1,"prepare.queue_time_us":999854,"prepare.run_cpu_time_us":475,"prepare.run_wall_time_us":475,"replication_time_us":7798}]]} 08:29:20.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.589120 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=850, attempt_no=1}) took 1009ms. Request Metrics: {"spinlock_wait_cycles":15744,"child_traces":[["txn",{"apply.queue_time_us":767,"num_ops":1,"prepare.queue_time_us":1000292,"prepare.run_cpu_time_us":417,"prepare.run_wall_time_us":417,"replication_time_us":7456,"spinlock_wait_cycles":19200}]]} 08:29:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.590895 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=852, attempt_no=1}) took 1011ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":199,"num_ops":1,"prepare.queue_time_us":1000544,"prepare.run_cpu_time_us":476,"prepare.run_wall_time_us":4471,"replication_time_us":5301}]]} 08:29:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.591377 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=853, attempt_no=1}) took 1011ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":633,"num_ops":1,"prepare.queue_time_us":1004958,"prepare.run_cpu_time_us":399,"prepare.run_wall_time_us":398,"replication_time_us":4927}]]} 08:29:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.591871 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=851, attempt_no=1}) took 1012ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1056,"num_ops":1,"prepare.queue_time_us":1005202,"prepare.run_cpu_time_us":387,"prepare.run_wall_time_us":387,"replication_time_us":4554}]]} 08:29:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.592344 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=855, attempt_no=1}) took 1012ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1502,"num_ops":1,"prepare.queue_time_us":1005553,"prepare.run_cpu_time_us":432,"prepare.run_wall_time_us":431,"replication_time_us":4171}]]} 08:29:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.593940 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=857, attempt_no=1}) took 1013ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":36,"num_ops":1,"prepare.queue_time_us":1005817,"prepare.run_cpu_time_us":409,"prepare.run_wall_time_us":409,"replication_time_us":6623}]]} 08:29:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.594494 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=856, attempt_no=1}) took 1014ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":612,"num_ops":1,"prepare.queue_time_us":1006181,"prepare.run_cpu_time_us":433,"prepare.run_wall_time_us":432,"replication_time_us":6237,"spinlock_wait_cycles":4992}]]} 08:29:20.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.598341 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=858, attempt_no=1}) took 1017ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":200,"num_ops":1,"prepare.queue_time_us":1006347,"prepare.run_cpu_time_us":407,"prepare.run_wall_time_us":407,"replication_time_us":9998,"spinlock_wait_cycles":2432}]]} 08:29:20.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.598865 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=859, attempt_no=1}) took 1018ms. Request Metrics: {"spinlock_wait_cycles":50048,"child_traces":[["txn",{"apply.queue_time_us":705,"num_ops":1,"prepare.queue_time_us":1006739,"prepare.run_cpu_time_us":388,"prepare.run_wall_time_us":387,"replication_time_us":9645}]]} 08:29:20.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.599350 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=838, attempt_no=1}) took 1022ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1145,"num_ops":1,"prepare.queue_time_us":1006861,"prepare.run_cpu_time_us":397,"prepare.run_wall_time_us":395,"replication_time_us":9286}]]} 08:29:20.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.601869 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=854, attempt_no=1}) took 1021ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":291,"num_ops":1,"prepare.queue_time_us":1007037,"prepare.run_cpu_time_us":455,"prepare.run_wall_time_us":2517,"replication_time_us":10084}]]} 08:29:20.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.602383 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=837, attempt_no=1}) took 1025ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":747,"num_ops":1,"prepare.queue_time_us":1009210,"prepare.run_cpu_time_us":402,"prepare.run_wall_time_us":400,"replication_time_us":9739}]]} 08:29:20.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.602880 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=860, attempt_no=1}) took 1018ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1182,"num_ops":1,"prepare.queue_time_us":1006102,"prepare.run_cpu_time_us":402,"prepare.run_wall_time_us":402,"replication_time_us":9339}]]} 08:29:20.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.603451 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=861, attempt_no=1}) took 1017ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1642,"num_ops":1,"prepare.queue_time_us":1006245,"prepare.run_cpu_time_us":391,"prepare.run_wall_time_us":390,"replication_time_us":8967}]]} 08:29:20.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.603956 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=863, attempt_no=1}) took 1018ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2152,"num_ops":1,"prepare.queue_time_us":1006389,"prepare.run_cpu_time_us":503,"prepare.run_wall_time_us":520,"replication_time_us":8558,"spinlock_wait_cycles":157952}]]} 08:29:20.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.611483 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=864, attempt_no=1}) took 1025ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":364,"num_ops":1,"prepare.queue_time_us":1006640,"prepare.run_cpu_time_us":526,"prepare.run_wall_time_us":6280,"replication_time_us":17242,"spinlock_wait_cycles":13349248}]]} 08:29:20.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.612722 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=865, attempt_no=1}) took 1026ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":121,"num_ops":1,"prepare.queue_time_us":1012648,"prepare.run_cpu_time_us":413,"prepare.run_wall_time_us":413,"replication_time_us":12426}]]} 08:29:20.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.613551 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=868, attempt_no=1}) took 1026ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1010,"num_ops":1,"prepare.queue_time_us":1012680,"prepare.run_cpu_time_us":374,"prepare.run_wall_time_us":373,"replication_time_us":12090}]]} 08:29:20.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.614837 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=869, attempt_no=1}) took 1027ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":170,"num_ops":1,"prepare.queue_time_us":1013047,"prepare.run_cpu_time_us":408,"prepare.run_wall_time_us":408,"replication_time_us":13690}]]} 08:29:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.615352 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=870, attempt_no=1}) took 1028ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":640,"num_ops":1,"prepare.queue_time_us":1013218,"prepare.run_cpu_time_us":422,"prepare.run_wall_time_us":4329,"replication_time_us":13318}]]} 08:29:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.615911 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=871, attempt_no=1}) took 1028ms. Request Metrics: {"spinlock_wait_cycles":38784,"child_traces":[["txn",{"apply.queue_time_us":1079,"num_ops":1,"prepare.queue_time_us":1017531,"prepare.run_cpu_time_us":454,"prepare.run_wall_time_us":452,"replication_time_us":9024}]]} 08:29:20.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.617276 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=872, attempt_no=1}) took 1029ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":63,"num_ops":1,"prepare.queue_time_us":1017705,"prepare.run_cpu_time_us":400,"prepare.run_wall_time_us":398,"replication_time_us":10904}]]} 08:29:20.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.619048 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=874, attempt_no=1}) took 1031ms. Request Metrics: {"spinlock_wait_cycles":51584,"child_traces":[["txn",{"apply.queue_time_us":123,"num_ops":1,"prepare.queue_time_us":1017810,"prepare.run_cpu_time_us":444,"prepare.run_wall_time_us":443,"replication_time_us":12201,"spinlock_wait_cycles":68608}]]} 08:29:20.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.619598 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=873, attempt_no=1}) took 1031ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":610,"num_ops":1,"prepare.queue_time_us":1018277,"prepare.run_cpu_time_us":495,"prepare.run_wall_time_us":505,"replication_time_us":11785,"spinlock_wait_cycles":167296}]]} 08:29:20.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.621047 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=876, attempt_no=1}) took 1032ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":330,"num_ops":1,"prepare.queue_time_us":1018556,"prepare.run_cpu_time_us":391,"prepare.run_wall_time_us":390,"replication_time_us":12950}]]} 08:29:20.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.621589 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=875, attempt_no=1}) took 1033ms. Request Metrics: {"spinlock_wait_cycles":33664,"child_traces":[["txn",{"apply.queue_time_us":817,"num_ops":1,"prepare.queue_time_us":1018951,"prepare.run_cpu_time_us":401,"prepare.run_wall_time_us":400,"replication_time_us":12595}]]} 08:29:20.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.622129 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=866, attempt_no=1}) took 1035ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1254,"num_ops":1,"prepare.queue_time_us":1019215,"prepare.run_cpu_time_us":394,"prepare.run_wall_time_us":394,"replication_time_us":12241}]]} 08:29:20.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.622654 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=878, attempt_no=1}) took 1034ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1686,"num_ops":1,"prepare.queue_time_us":1019534,"prepare.run_cpu_time_us":469,"prepare.run_wall_time_us":468,"replication_time_us":11894}]]} 08:29:20.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.624385 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=877, attempt_no=1}) took 1036ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":204,"num_ops":1,"prepare.queue_time_us":1019819,"prepare.run_cpu_time_us":408,"prepare.run_wall_time_us":407,"replication_time_us":14610}]]} 08:29:20.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.624943 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=881, attempt_no=1}) took 1035ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":684,"num_ops":1,"prepare.queue_time_us":1019987,"prepare.run_cpu_time_us":405,"prepare.run_wall_time_us":405,"replication_time_us":14245}]]} 08:29:20.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.625514 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=880, attempt_no=1}) took 1036ms. Request Metrics: {"spinlock_wait_cycles":35712,"child_traces":[["txn",{"apply.queue_time_us":1139,"num_ops":1,"prepare.queue_time_us":1020375,"prepare.run_cpu_time_us":410,"prepare.run_wall_time_us":410,"replication_time_us":13885,"spinlock_wait_cycles":6400}]]} 08:29:20.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.627337 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=867, attempt_no=1}) took 1040ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":70,"num_ops":1,"prepare.queue_time_us":1020577,"prepare.run_cpu_time_us":390,"prepare.run_wall_time_us":388,"replication_time_us":16402}]]} 08:29:20.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.633229 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=879, attempt_no=1}) took 1044ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":101,"num_ops":1,"prepare.queue_time_us":1020715,"prepare.run_cpu_time_us":589,"prepare.run_wall_time_us":18954,"raft.queue_time_us":314,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":299,"replication_time_us":21632,"spinlock_wait_cycles":42320512}]]} 08:29:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.640275 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=884, attempt_no=1}) took 1050ms. Request Metrics: {"spinlock_wait_cycles":37120,"child_traces":[["txn",{"apply.queue_time_us":54,"num_ops":1,"prepare.queue_time_us":1039656,"prepare.run_cpu_time_us":493,"prepare.run_wall_time_us":492,"replication_time_us":9744}]]} 08:29:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.640584 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=886, attempt_no=1}) took 1050ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":370,"num_ops":1,"prepare.queue_time_us":1039887,"prepare.run_cpu_time_us":418,"prepare.run_wall_time_us":416,"replication_time_us":9388}]]} 08:29:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.641196 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=883, attempt_no=1}) took 1051ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":576,"num_ops":1,"prepare.queue_time_us":1040114,"prepare.run_cpu_time_us":386,"prepare.run_wall_time_us":385,"replication_time_us":8995}]]} 08:29:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.641214 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=885, attempt_no=1}) took 1051ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":821,"mutex_wait_us":19,"num_ops":1,"prepare.queue_time_us":1040673,"prepare.run_cpu_time_us":640,"prepare.run_wall_time_us":8102,"raft.queue_time_us":43,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":152,"replication_time_us":8252,"spinlock_wait_cycles":17203072}]]} 08:29:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.641593 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=887, attempt_no=1}) took 1051ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":840,"num_ops":1,"prepare.queue_time_us":1040460,"prepare.run_cpu_time_us":378,"prepare.run_wall_time_us":376,"replication_time_us":8635}]]} 08:29:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.644882 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=889, attempt_no=1}) took 1054ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":43,"mutex_wait_us":29,"num_ops":1,"prepare.queue_time_us":1048725,"prepare.run_cpu_time_us":737,"prepare.run_wall_time_us":3641,"raft.queue_time_us":68,"raft.run_cpu_time_us":509,"raft.run_wall_time_us":525,"replication_time_us":4377,"spinlock_wait_cycles":4244864}]]} 08:29:20.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.646847 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=888, attempt_no=1}) took 1056ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":69,"num_ops":1,"prepare.queue_time_us":1052190,"prepare.run_cpu_time_us":396,"prepare.run_wall_time_us":396,"replication_time_us":2823}]]} 08:29:20.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.647037 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=891, attempt_no=1}) took 1056ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":41,"num_ops":1,"prepare.queue_time_us":1052552,"prepare.run_cpu_time_us":398,"prepare.run_wall_time_us":398,"replication_time_us":2526}]]} 08:29:20.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.649834 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=882, attempt_no=1}) took 1060ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":39,"mutex_wait_us":20,"num_ops":1,"prepare.queue_time_us":1052969,"prepare.run_cpu_time_us":581,"prepare.run_wall_time_us":1662,"replication_time_us":4959,"spinlock_wait_cycles":2667136}]]} 08:29:20.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.651973 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=898, attempt_no=1}) took 1059ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":46,"num_ops":1,"prepare.queue_time_us":1052983,"prepare.run_cpu_time_us":399,"prepare.run_wall_time_us":398,"replication_time_us":3445,"spinlock_wait_cycles":5986688}]]} 08:29:20.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.651993 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=893, attempt_no=1}) took 1060ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":51,"num_ops":1,"prepare.queue_time_us":1054386,"prepare.run_cpu_time_us":507,"prepare.run_wall_time_us":2029,"replication_time_us":5360,"spinlock_wait_cycles":53504}]]} 08:29:20.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.652595 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=894, attempt_no=1}) took 1061ms. Request Metrics: {"spinlock_wait_cycles":6516992,"child_traces":[["txn",{"apply.queue_time_us":31,"num_ops":1,"prepare.queue_time_us":1053360,"prepare.run_cpu_time_us":333,"prepare.run_wall_time_us":332,"replication_time_us":3624}]]} 08:29:20.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.655632 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=911, attempt_no=1}) took 1061ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":50,"num_ops":1,"prepare.queue_time_us":1053483,"prepare.run_cpu_time_us":379,"prepare.run_wall_time_us":611,"replication_time_us":6023}]]} 08:29:20.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.658023 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=912, attempt_no=1}) took 1063ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":111,"num_ops":1,"prepare.queue_time_us":1054091,"prepare.run_cpu_time_us":548,"prepare.run_wall_time_us":4070,"replication_time_us":7966,"spinlock_wait_cycles":8313088}]]} 08:29:20.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.658509 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=913, attempt_no=1}) took 1063ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":538,"num_ops":1,"prepare.queue_time_us":1057950,"prepare.run_cpu_time_us":401,"prepare.run_wall_time_us":400,"replication_time_us":3926}]]} 08:29:20.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.661753 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=914, attempt_no=1}) took 1067ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":268,"num_ops":1,"prepare.queue_time_us":1058344,"prepare.run_cpu_time_us":358,"prepare.run_wall_time_us":358,"replication_time_us":6857}]]} 08:29:20.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.662328 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=915, attempt_no=1}) took 1067ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":784,"num_ops":1,"prepare.queue_time_us":1058499,"prepare.run_cpu_time_us":474,"prepare.run_wall_time_us":1168,"replication_time_us":6603,"spinlock_wait_cycles":1159936}]]} 08:29:20.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.662829 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=916, attempt_no=1}) took 1067ms. Request Metrics: {"spinlock_wait_cycles":3456,"child_traces":[["txn",{"apply.queue_time_us":1232,"num_ops":1,"prepare.queue_time_us":1059679,"prepare.run_cpu_time_us":306,"prepare.run_wall_time_us":1268,"replication_time_us":4593}]]} 08:29:20.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.663614 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=917, attempt_no=1}) took 1068ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":56,"num_ops":1,"prepare.queue_time_us":1060709,"replication_time_us":6150}]]} 08:29:20.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.666828 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=918, attempt_no=1}) took 1071ms. Request Metrics: {"spinlock_wait_cycles":85376,"child_traces":[["txn",{"apply.queue_time_us":57,"num_ops":1,"prepare.queue_time_us":1067763,"prepare.run_cpu_time_us":458,"prepare.run_wall_time_us":955,"raft.queue_time_us":32,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":197,"replication_time_us":2201,"spinlock_wait_cycles":104576}]]} 08:29:20.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.674440 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=919, attempt_no=1}) took 1078ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":401,"num_ops":1,"prepare.queue_time_us":1068559,"prepare.run_cpu_time_us":440,"prepare.run_wall_time_us":439,"replication_time_us":8484}]]} 08:29:20.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.674974 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=920, attempt_no=1}) took 1079ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":884,"num_ops":1,"prepare.queue_time_us":1068975,"prepare.run_cpu_time_us":395,"prepare.run_wall_time_us":393,"replication_time_us":8093}]]} 08:29:20.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.675485 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=921, attempt_no=1}) took 1079ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1330,"num_ops":1,"prepare.queue_time_us":1069181,"prepare.run_cpu_time_us":402,"prepare.run_wall_time_us":402,"replication_time_us":7717}]]} 08:29:20.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.675997 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=922, attempt_no=1}) took 1080ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1782,"num_ops":1,"prepare.queue_time_us":1069560,"prepare.run_cpu_time_us":377,"prepare.run_wall_time_us":375,"replication_time_us":7358}]]} 08:29:20.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.676518 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=908, attempt_no=1}) took 1082ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2245,"num_ops":1,"prepare.queue_time_us":1069686,"prepare.run_cpu_time_us":384,"prepare.run_wall_time_us":384,"replication_time_us":7011,"spinlock_wait_cycles":6005120}]]} 08:29:20.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.677194 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=925, attempt_no=1}) took 1080ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2827,"num_ops":1,"prepare.queue_time_us":1070243,"prepare.run_cpu_time_us":524,"prepare.run_wall_time_us":2673,"replication_time_us":6255,"spinlock_wait_cycles":5046528}]]} 08:29:20.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.677737 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=926, attempt_no=1}) took 1081ms. Request Metrics: {"spinlock_wait_cycles":24960,"child_traces":[["txn",{"apply.queue_time_us":397,"num_ops":1,"prepare.queue_time_us":1072913,"prepare.run_cpu_time_us":423,"prepare.run_wall_time_us":423,"replication_time_us":6469}]]} 08:29:20.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.678231 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=927, attempt_no=1}) took 1081ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":884,"num_ops":1,"prepare.queue_time_us":1073131,"prepare.run_cpu_time_us":295,"prepare.run_wall_time_us":294,"replication_time_us":6156}]]} 08:29:20.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.678740 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=928, attempt_no=1}) took 1081ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1329,"num_ops":1,"prepare.queue_time_us":1073419,"prepare.run_cpu_time_us":301,"prepare.run_wall_time_us":299,"replication_time_us":5900}]]} 08:29:20.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.679232 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=929, attempt_no=1}) took 1082ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1789,"num_ops":1,"prepare.queue_time_us":1073489,"prepare.run_cpu_time_us":294,"prepare.run_wall_time_us":293,"replication_time_us":5613}]]} 08:29:20.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.679754 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=930, attempt_no=1}) took 1082ms. Request Metrics: {"spinlock_wait_cycles":17792,"child_traces":[["txn",{"apply.queue_time_us":2243,"num_ops":1,"prepare.queue_time_us":1073766,"prepare.run_cpu_time_us":293,"prepare.run_wall_time_us":292,"replication_time_us":5323}]]} 08:29:20.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.680249 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=931, attempt_no=1}) took 1082ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2720,"num_ops":1,"prepare.queue_time_us":1073856,"prepare.run_cpu_time_us":278,"prepare.run_wall_time_us":277,"replication_time_us":5063}]]} 08:29:20.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.680676 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=932, attempt_no=1}) took 1083ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":3159,"num_ops":1,"prepare.queue_time_us":1074077,"prepare.run_cpu_time_us":298,"prepare.run_wall_time_us":296,"replication_time_us":4809,"spinlock_wait_cycles":2432}]]} 08:29:20.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.682572 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=909, attempt_no=1}) took 1088ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2712,"mutex_wait_us":3,"num_ops":1,"prepare.queue_time_us":1070099,"prepare.run_cpu_time_us":377,"prepare.run_wall_time_us":376,"replication_time_us":6635,"spinlock_wait_cycles":6105344}]]} 08:29:20.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.684049 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=933, attempt_no=1}) took 1086ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":79,"mutex_wait_us":361,"num_ops":1,"prepare.queue_time_us":1074225,"prepare.run_cpu_time_us":449,"prepare.run_wall_time_us":10444,"raft.queue_time_us":33,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":150,"replication_time_us":10684,"spinlock_wait_cycles":189952}]]} 08:29:20.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.686849 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=934, attempt_no=1}) took 1088ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":48,"num_ops":1,"prepare.queue_time_us":1084598,"prepare.run_cpu_time_us":473,"prepare.run_wall_time_us":1189,"raft.queue_time_us":38,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":172,"replication_time_us":3136,"spinlock_wait_cycles":371328}]]} 08:29:20.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.695771 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=935, attempt_no=1}) took 1097ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":815,"num_ops":1,"prepare.queue_time_us":1085632,"prepare.run_cpu_time_us":446,"prepare.run_wall_time_us":478,"replication_time_us":9888}]]} 08:29:20.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.696282 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=936, attempt_no=1}) took 1098ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1391,"num_ops":1,"prepare.queue_time_us":1086040,"prepare.run_cpu_time_us":447,"prepare.run_wall_time_us":447,"replication_time_us":9471}]]} 08:29:20.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.696797 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=937, attempt_no=1}) took 1098ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1529,"num_ops":1,"prepare.queue_time_us":1086605,"prepare.run_cpu_time_us":450,"prepare.run_wall_time_us":476,"replication_time_us":9104}]]} 08:29:20.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.697307 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=938, attempt_no=1}) took 1098ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1932,"num_ops":1,"prepare.queue_time_us":1086965,"prepare.run_cpu_time_us":399,"prepare.run_wall_time_us":398,"replication_time_us":8764,"spinlock_wait_cycles":4352}]]} 08:29:20.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.697780 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=939, attempt_no=1}) took 1099ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2369,"num_ops":1,"prepare.queue_time_us":1087291,"prepare.run_cpu_time_us":319,"prepare.run_wall_time_us":318,"replication_time_us":8458}]]} 08:29:20.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.698232 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=940, attempt_no=1}) took 1099ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2805,"num_ops":1,"prepare.queue_time_us":1087419,"prepare.run_cpu_time_us":399,"prepare.run_wall_time_us":397,"replication_time_us":8097}]]} 08:29:20.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.698714 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=941, attempt_no=1}) took 1099ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":3202,"num_ops":1,"prepare.queue_time_us":1087825,"prepare.run_cpu_time_us":444,"prepare.run_wall_time_us":442,"replication_time_us":7715}]]} 08:29:20.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.699174 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=942, attempt_no=1}) took 1100ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":3645,"num_ops":1,"prepare.queue_time_us":1088075,"prepare.run_cpu_time_us":396,"prepare.run_wall_time_us":396,"replication_time_us":7278}]]} 08:29:20.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.699595 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=943, attempt_no=1}) took 1100ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2606,"num_ops":1,"prepare.queue_time_us":1088456,"replication_time_us":8328,"spinlock_wait_cycles":12413056}]]} 08:29:20.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.703939 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=944, attempt_no=1}) took 1104ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":60,"num_ops":1,"prepare.queue_time_us":1100863,"prepare.run_cpu_time_us":529,"prepare.run_wall_time_us":528,"raft.queue_time_us":110,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":397,"replication_time_us":2317,"spinlock_wait_cycles":198656}]]} 08:29:20.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.707020 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=945, attempt_no=1}) took 1107ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":243,"num_ops":1,"prepare.queue_time_us":1101387,"prepare.run_cpu_time_us":386,"prepare.run_wall_time_us":386,"replication_time_us":4821}]]} 08:29:20.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.707128 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=902, attempt_no=1}) took 1114ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":279,"num_ops":1,"prepare.queue_time_us":1101587,"prepare.run_cpu_time_us":389,"prepare.run_wall_time_us":390,"replication_time_us":4462,"spinlock_wait_cycles":15481728}]]} 08:29:20.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.707553 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=947, attempt_no=1}) took 1107ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":699,"num_ops":1,"prepare.queue_time_us":1101934,"prepare.run_cpu_time_us":342,"prepare.run_wall_time_us":340,"replication_time_us":4129}]]} 08:29:20.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.707873 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=949, attempt_no=1}) took 1107ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":956,"num_ops":1,"prepare.queue_time_us":1102460,"prepare.run_cpu_time_us":381,"prepare.run_wall_time_us":379,"replication_time_us":3433,"spinlock_wait_cycles":1280}]]} 08:29:20.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.707558 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=948, attempt_no=1}) took 1107ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":689,"num_ops":1,"prepare.queue_time_us":1102107,"prepare.run_cpu_time_us":413,"prepare.run_wall_time_us":421,"replication_time_us":3866,"spinlock_wait_cycles":181120}]]} 08:29:20.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.714644 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=950, attempt_no=1}) took 1114ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":324,"num_ops":1,"prepare.queue_time_us":1102690,"prepare.run_cpu_time_us":372,"prepare.run_wall_time_us":371,"replication_time_us":10313}]]} 08:29:20.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.715162 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=901, attempt_no=1}) took 1122ms. Request Metrics: {"spinlock_wait_cycles":39808,"child_traces":[["txn",{"apply.queue_time_us":776,"num_ops":1,"prepare.queue_time_us":1102852,"prepare.run_cpu_time_us":366,"prepare.run_wall_time_us":365,"replication_time_us":9987,"spinlock_wait_cycles":18352512}]]} 08:29:20.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.715638 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=952, attempt_no=1}) took 1115ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1222,"num_ops":1,"prepare.queue_time_us":1103191,"prepare.run_cpu_time_us":380,"prepare.run_wall_time_us":379,"replication_time_us":9642}]]} 08:29:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.716109 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=953, attempt_no=1}) took 1115ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1613,"num_ops":1,"prepare.queue_time_us":1103371,"prepare.run_cpu_time_us":443,"prepare.run_wall_time_us":1047,"replication_time_us":8636}]]} 08:29:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.716619 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=954, attempt_no=1}) took 1115ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2042,"num_ops":1,"prepare.queue_time_us":1104393,"prepare.run_cpu_time_us":389,"prepare.run_wall_time_us":389,"replication_time_us":8263}]]} 08:29:20.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.719041 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=955, attempt_no=1}) took 1117ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":56,"num_ops":1,"prepare.queue_time_us":1104613,"prepare.run_cpu_time_us":579,"prepare.run_wall_time_us":2930,"replication_time_us":12244,"spinlock_wait_cycles":5521792}]]} 08:29:20.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.719444 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=956, attempt_no=1}) took 1118ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":399,"num_ops":1,"prepare.queue_time_us":1107497,"prepare.run_cpu_time_us":394,"prepare.run_wall_time_us":394,"replication_time_us":9360}]]} 08:29:20.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.719504 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=957, attempt_no=1}) took 1118ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":442,"num_ops":1,"prepare.queue_time_us":1107724,"prepare.run_cpu_time_us":376,"prepare.run_wall_time_us":375,"replication_time_us":8999}]]} 08:29:20.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.719897 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=958, attempt_no=1}) took 1118ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":774,"num_ops":1,"prepare.queue_time_us":1108038,"prepare.run_cpu_time_us":390,"prepare.run_wall_time_us":389,"replication_time_us":8640}]]} 08:29:20.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.720376 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=960, attempt_no=1}) took 1118ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1142,"num_ops":1,"prepare.queue_time_us":1108599,"prepare.run_cpu_time_us":373,"prepare.run_wall_time_us":372,"replication_time_us":7895}]]} 08:29:20.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.721194 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=961, attempt_no=1}) took 1119ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1846,"num_ops":1,"prepare.queue_time_us":1109222,"prepare.run_cpu_time_us":389,"prepare.run_wall_time_us":389,"replication_time_us":7126}]]} 08:29:20.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.721693 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=907, attempt_no=1}) took 1128ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2327,"num_ops":1,"prepare.queue_time_us":1109609,"prepare.run_cpu_time_us":386,"prepare.run_wall_time_us":385,"replication_time_us":6748,"spinlock_wait_cycles":19378560}]]} 08:29:20.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.722162 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=904, attempt_no=1}) took 1129ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2784,"num_ops":1,"prepare.queue_time_us":1109929,"prepare.run_cpu_time_us":434,"prepare.run_wall_time_us":5582,"replication_time_us":6361,"spinlock_wait_cycles":20258688}]]} 08:29:20.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.719897 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=959, attempt_no=1}) took 1118ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":757,"num_ops":1,"prepare.queue_time_us":1108273,"prepare.run_cpu_time_us":380,"prepare.run_wall_time_us":380,"replication_time_us":8260,"spinlock_wait_cycles":31104}]]} 08:29:20.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.723047 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=905, attempt_no=1}) took 1127ms. Request Metrics: {"spinlock_wait_cycles":167680,"child_traces":[["txn",{"apply.queue_time_us":1570,"num_ops":1,"prepare.queue_time_us":1108882,"prepare.run_cpu_time_us":385,"prepare.run_wall_time_us":384,"replication_time_us":7514,"spinlock_wait_cycles":19833216}]]} 08:29:20.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.725628 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=906, attempt_no=1}) took 1132ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":100,"num_ops":1,"prepare.queue_time_us":1115526,"prepare.run_cpu_time_us":399,"prepare.run_wall_time_us":5460,"replication_time_us":6588,"spinlock_wait_cycles":19595520}]]} 08:29:20.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.729497 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=903, attempt_no=1}) took 1136ms. Request Metrics: {"spinlock_wait_cycles":2533760,"child_traces":[["txn",{"apply.queue_time_us":175,"num_ops":1,"prepare.queue_time_us":1120886,"prepare.run_cpu_time_us":449,"prepare.run_wall_time_us":685,"replication_time_us":5079,"spinlock_wait_cycles":18781056}]]} 08:29:20.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.730046 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=963, attempt_no=1}) took 1127ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":671,"num_ops":1,"prepare.queue_time_us":1121427,"prepare.run_cpu_time_us":498,"prepare.run_wall_time_us":2333,"replication_time_us":4497,"spinlock_wait_cycles":3683584}]]} 08:29:20.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.734287 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=964, attempt_no=1}) took 1131ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":39,"num_ops":1,"prepare.queue_time_us":1123674,"prepare.run_cpu_time_us":315,"prepare.run_wall_time_us":482,"replication_time_us":7025}]]} 08:29:20.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.734586 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=962, attempt_no=1}) took 1132ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":191,"num_ops":1,"prepare.queue_time_us":1123983,"prepare.run_cpu_time_us":381,"prepare.run_wall_time_us":556,"replication_time_us":6555}]]} 08:29:20.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.734760 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=965, attempt_no=1}) took 1132ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":446,"num_ops":1,"prepare.queue_time_us":1124512,"prepare.run_cpu_time_us":381,"prepare.run_wall_time_us":535,"replication_time_us":6018}]]} 08:29:20.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.735097 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=900, attempt_no=1}) took 1142ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":707,"num_ops":1,"prepare.queue_time_us":1124958,"prepare.run_cpu_time_us":643,"prepare.run_wall_time_us":2529,"raft.queue_time_us":65,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":262,"replication_time_us":5510,"spinlock_wait_cycles":28679424}]]} 08:29:20.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.741215 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=966, attempt_no=1}) took 1138ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":177,"num_ops":1,"prepare.queue_time_us":1127427,"prepare.run_cpu_time_us":479,"prepare.run_wall_time_us":478,"replication_time_us":9448}]]} 08:29:20.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.741750 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=969, attempt_no=1}) took 1138ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":654,"num_ops":1,"prepare.queue_time_us":1127647,"prepare.run_cpu_time_us":414,"prepare.run_wall_time_us":572,"replication_time_us":9080}]]} 08:29:20.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.743041 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=970, attempt_no=1}) took 1139ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":138,"num_ops":1,"prepare.queue_time_us":1128556,"prepare.run_cpu_time_us":458,"prepare.run_wall_time_us":621,"replication_time_us":9579}]]} 08:29:20.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.743129 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=899, attempt_no=1}) took 1150ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":197,"mutex_wait_us":332,"num_ops":1,"prepare.queue_time_us":1128547,"prepare.run_cpu_time_us":409,"prepare.run_wall_time_us":579,"replication_time_us":8539,"spinlock_wait_cycles":25060608}]]} 08:29:20.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.743595 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=968, attempt_no=1}) took 1140ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":649,"mutex_wait_us":301,"num_ops":1,"prepare.queue_time_us":1129478,"prepare.run_cpu_time_us":722,"prepare.run_wall_time_us":2685,"raft.queue_time_us":80,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":271,"replication_time_us":9078,"spinlock_wait_cycles":4822144}]]} 08:29:20.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.747336 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=971, attempt_no=1}) took 1143ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":467,"mutex_wait_us":33,"num_ops":1,"prepare.queue_time_us":1131888,"prepare.run_cpu_time_us":434,"prepare.run_wall_time_us":434,"replication_time_us":10266}]]} 08:29:20.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.747759 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=910, attempt_no=1}) took 1153ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":870,"num_ops":1,"prepare.queue_time_us":1132204,"prepare.run_cpu_time_us":472,"prepare.run_wall_time_us":645,"replication_time_us":9878,"spinlock_wait_cycles":21565696}]]} 08:29:20.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.748275 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=972, attempt_no=1}) took 1144ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1237,"num_ops":1,"prepare.queue_time_us":1132771,"prepare.run_cpu_time_us":428,"prepare.run_wall_time_us":427,"replication_time_us":9293}]]} 08:29:20.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.748721 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=974, attempt_no=1}) took 1144ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1680,"num_ops":1,"prepare.queue_time_us":1133054,"prepare.run_cpu_time_us":446,"prepare.run_wall_time_us":614,"replication_time_us":8877}]]} 08:29:20.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.749219 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=967, attempt_no=1}) took 1146ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2097,"num_ops":1,"prepare.queue_time_us":1133546,"prepare.run_cpu_time_us":422,"prepare.run_wall_time_us":422,"replication_time_us":8307}]]} 08:29:20.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.749689 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=975, attempt_no=1}) took 1145ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":2537,"num_ops":1,"prepare.queue_time_us":1133839,"prepare.run_cpu_time_us":401,"prepare.run_wall_time_us":577,"replication_time_us":7903}]]} 08:29:20.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.750180 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=890, attempt_no=1}) took 1159ms. Request Metrics: {"spinlock_wait_cycles":40320,"child_traces":[["txn",{"apply.queue_time_us":2960,"num_ops":1,"prepare.queue_time_us":1134331,"prepare.run_cpu_time_us":415,"prepare.run_wall_time_us":414,"replication_time_us":7323,"spinlock_wait_cycles":21812096}]]} 08:29:20.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.750667 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=976, attempt_no=1}) took 1146ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":3425,"num_ops":1,"prepare.queue_time_us":1134755,"prepare.run_cpu_time_us":405,"prepare.run_wall_time_us":404,"replication_time_us":6918}]]} 08:29:20.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.751122 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=978, attempt_no=1}) took 1146ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":3860,"num_ops":1,"prepare.queue_time_us":1134951,"prepare.run_cpu_time_us":427,"prepare.run_wall_time_us":4521,"replication_time_us":6516}]]} 08:29:20.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.751580 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=973, attempt_no=1}) took 1147ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":144,"num_ops":1,"prepare.queue_time_us":1139440,"prepare.run_cpu_time_us":437,"prepare.run_wall_time_us":436,"replication_time_us":6077}]]} 08:29:20.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.752075 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=862, attempt_no=1}) took 1166ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":569,"num_ops":1,"prepare.queue_time_us":1139676,"prepare.run_cpu_time_us":389,"prepare.run_wall_time_us":388,"replication_time_us":5702}]]} 08:29:20.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.752570 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=977, attempt_no=1}) took 1147ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1008,"num_ops":1,"prepare.queue_time_us":1140042,"replication_time_us":5327,"spinlock_wait_cycles":999296}]]} 08:29:20.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.757668 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=980, attempt_no=1}) took 1152ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":200,"num_ops":1,"prepare.queue_time_us":1147065,"prepare.run_cpu_time_us":529,"prepare.run_wall_time_us":529,"replication_time_us":3807}]]} 08:29:20.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.758183 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=979, attempt_no=1}) took 1153ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":687,"num_ops":1,"prepare.queue_time_us":1147574,"prepare.run_cpu_time_us":381,"prepare.run_wall_time_us":380,"replication_time_us":3416}]]} 08:29:20.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.758672 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=892, attempt_no=1}) took 1167ms. Request Metrics: {"spinlock_wait_cycles":3362688,"child_traces":[["txn",{"apply.queue_time_us":1125,"num_ops":1,"prepare.queue_time_us":1147918,"prepare.run_cpu_time_us":431,"prepare.run_wall_time_us":470,"replication_time_us":3061,"spinlock_wait_cycles":26287744}]]} 08:29:20.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.761997 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=981, attempt_no=1}) took 1156ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":69,"num_ops":1,"prepare.queue_time_us":1148188,"prepare.run_cpu_time_us":456,"prepare.run_wall_time_us":3135,"replication_time_us":4187}]]} 08:29:20.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.765735 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=983, attempt_no=1}) took 1159ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":51,"mutex_wait_us":27,"num_ops":1,"prepare.queue_time_us":1151311,"prepare.run_cpu_time_us":459,"prepare.run_wall_time_us":5551,"replication_time_us":2286}]]} 08:29:20.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.769029 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=982, attempt_no=1}) took 1163ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":115,"num_ops":1,"prepare.queue_time_us":1156662,"prepare.run_cpu_time_us":492,"prepare.run_wall_time_us":1040,"replication_time_us":4179,"spinlock_wait_cycles":48000}]]} 08:29:20.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.769280 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=984, attempt_no=1}) took 1163ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":598,"mutex_wait_us":543,"num_ops":1,"prepare.queue_time_us":1157689,"prepare.run_cpu_time_us":468,"prepare.run_wall_time_us":873,"replication_time_us":3791,"spinlock_wait_cycles":73088}]]} 08:29:20.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.771095 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=985, attempt_no=1}) took 1164ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":59,"num_ops":1,"prepare.queue_time_us":1158327,"prepare.run_cpu_time_us":416,"prepare.run_wall_time_us":416,"replication_time_us":5175}]]} 08:29:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.774117 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=986, attempt_no=1}) took 1167ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":258,"num_ops":1,"prepare.queue_time_us":1158758,"prepare.run_cpu_time_us":364,"prepare.run_wall_time_us":773,"replication_time_us":7176}]]} 08:29:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.774668 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=987, attempt_no=1}) took 1168ms. Request Metrics: {"spinlock_wait_cycles":768,"child_traces":[["txn",{"apply.queue_time_us":798,"num_ops":1,"prepare.queue_time_us":1159293,"prepare.run_cpu_time_us":392,"prepare.run_wall_time_us":392,"replication_time_us":6843}]]} 08:29:20.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.775295 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=988, attempt_no=1}) took 1168ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1265,"num_ops":1,"prepare.queue_time_us":1159696,"prepare.run_cpu_time_us":432,"prepare.run_wall_time_us":431,"replication_time_us":6441}]]} 08:29:20.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.775822 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=989, attempt_no=1}) took 1168ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1832,"num_ops":1,"prepare.queue_time_us":1159899,"prepare.run_cpu_time_us":393,"prepare.run_wall_time_us":393,"replication_time_us":6074}]]} 08:29:20.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.778484 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=990, attempt_no=1}) took 1171ms. Request Metrics: {"spinlock_wait_cycles":1280,"child_traces":[["txn",{"apply.queue_time_us":32,"num_ops":1,"prepare.queue_time_us":1160289,"prepare.run_cpu_time_us":487,"prepare.run_wall_time_us":2761,"replication_time_us":7860,"spinlock_wait_cycles":269696}]]} 08:29:20.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.779201 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=992, attempt_no=1}) took 1171ms. Request Metrics: {"spinlock_wait_cycles":1280,"child_traces":[["txn",{"apply.queue_time_us":239,"num_ops":1,"prepare.queue_time_us":1163177,"prepare.run_cpu_time_us":418,"prepare.run_wall_time_us":586,"replication_time_us":7307}]]} 08:29:20.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.779333 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=994, attempt_no=1}) took 1171ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":313,"num_ops":1,"prepare.queue_time_us":1163518,"prepare.run_cpu_time_us":430,"prepare.run_wall_time_us":430,"replication_time_us":6882,"spinlock_wait_cycles":35584}]]} 08:29:20.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.779683 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=993, attempt_no=1}) took 1172ms. Request Metrics: {"spinlock_wait_cycles":35200,"child_traces":[["txn",{"apply.queue_time_us":606,"num_ops":1,"prepare.queue_time_us":1163966,"prepare.run_cpu_time_us":390,"prepare.run_wall_time_us":389,"replication_time_us":6479}]]} 08:29:20.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.779781 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=996, attempt_no=1}) took 1171ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":670,"num_ops":1,"prepare.queue_time_us":1164152,"prepare.run_cpu_time_us":544,"prepare.run_wall_time_us":3831,"replication_time_us":6087,"spinlock_wait_cycles":653696}]]} 08:29:20.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.780122 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=991, attempt_no=1}) took 1172ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":285,"mutex_wait_us":924,"num_ops":1,"prepare.queue_time_us":1162797,"prepare.run_cpu_time_us":359,"prepare.run_wall_time_us":358,"replication_time_us":7784,"spinlock_wait_cycles":1408}]]} 08:29:20.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.783349 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=995, attempt_no=1}) took 1175ms. Request Metrics: {"spinlock_wait_cycles":8448,"child_traces":[["txn",{"apply.queue_time_us":169,"num_ops":1,"prepare.queue_time_us":1167951,"prepare.run_cpu_time_us":492,"prepare.run_wall_time_us":491,"replication_time_us":6162}]]} 08:29:20.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.783831 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=998, attempt_no=1}) took 1175ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":638,"num_ops":1,"prepare.queue_time_us":1168281,"prepare.run_cpu_time_us":411,"prepare.run_wall_time_us":410,"replication_time_us":5737}]]} 08:29:20.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.784301 32136 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=997, attempt_no=1}) took 1176ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1058,"num_ops":1,"prepare.queue_time_us":1168692,"prepare.run_cpu_time_us":349,"prepare.run_wall_time_us":349,"replication_time_us":5362}]]} 08:29:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.789393 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=923, attempt_no=1}) took 1193ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":78,"num_ops":1,"prepare.queue_time_us":1168976,"prepare.run_cpu_time_us":606,"prepare.run_wall_time_us":3294,"replication_time_us":10658,"spinlock_wait_cycles":6016384}]]} 08:29:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.789439 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=999, attempt_no=1}) took 1180ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":212,"num_ops":1,"prepare.queue_time_us":1172090,"prepare.run_cpu_time_us":381,"prepare.run_wall_time_us":379,"replication_time_us":7578}]]} 08:29:20.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.789930 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=1000, attempt_no=1}) took 1181ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":662,"num_ops":1,"prepare.queue_time_us":1172379,"prepare.run_cpu_time_us":370,"prepare.run_wall_time_us":370,"replication_time_us":7230}]]} 08:29:20.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.789973 32145 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=924, attempt_no=1}) took 1193ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":653,"num_ops":1,"prepare.queue_time_us":1172759,"prepare.run_cpu_time_us":269,"prepare.run_wall_time_us":268,"replication_time_us":6948}]]} 08:29:20.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.790414 32146 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=951, attempt_no=1}) took 1189ms. Request Metrics: {"child_traces":[["txn",{"apply.queue_time_us":1052,"num_ops":1,"prepare.queue_time_us":1173027,"prepare.run_cpu_time_us":330,"prepare.run_wall_time_us":328,"replication_time_us":6687}]]} 08:29:20.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.794358 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=946, attempt_no=1}) took 1194ms. Request Metrics: {"spinlock_wait_cycles":21015808,"child_traces":[["txn",{"apply.queue_time_us":256,"num_ops":1,"prepare.queue_time_us":1172990,"prepare.run_cpu_time_us":370,"prepare.run_wall_time_us":1294,"replication_time_us":10053}]]} 08:29:20.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.794888 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=896, attempt_no=1}) took 1203ms. Request Metrics: {"spinlock_wait_cycles":1704704,"child_traces":[["txn",{"apply.queue_time_us":721,"num_ops":1,"prepare.queue_time_us":1174180,"prepare.run_cpu_time_us":346,"prepare.run_wall_time_us":345,"replication_time_us":9737,"spinlock_wait_cycles":39198080}]]} 08:29:20.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.795393 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=897, attempt_no=1}) took 1203ms. Request Metrics: {"spinlock_wait_cycles":15104,"child_traces":[["txn",{"apply.queue_time_us":1180,"num_ops":1,"prepare.queue_time_us":1174523,"prepare.run_cpu_time_us":364,"prepare.run_wall_time_us":364,"replication_time_us":9419}]]} 08:29:20.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.795897 32139 rpcz_store.cc:269] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35320 (ReqId={client: 98fc701ab5c646b48bf547c64ada68c1, seq_no=895, attempt_no=1}) took 1204ms. Request Metrics: {"spinlock_wait_cycles":41407360,"child_traces":[["txn",{"apply.queue_time_us":1636,"num_ops":1,"prepare.queue_time_us":1174635,"prepare.run_cpu_time_us":401,"prepare.run_wall_time_us":400,"replication_time_us":9034}]]} 08:29:20.805 [DEBUG - New I/O worker #58] (AsyncKuduScanner.java:1141) AsyncKuduScanner$Response(scannerId = "", data = RowResultIterator for 1000 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestAsyncKuduSession, tablet=cf4eaad7f2244671b3d1dfccf7824965, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=, endPrimaryKey=) 08:29:20.808 [DEBUG - New I/O worker #55] (Connection.java:691) [peer master-127.30.191.60:38723(127.30.191.60:38723)] cleaning up while in state READY due to: connection disconnected 08:29:20.813 [DEBUG - New I/O worker #58] (Connection.java:691) [peer ed61c27aa829404d8500d865f90ebbbe(127.30.191.1:35683)] cleaning up while in state READY due to: connection disconnected 08:29:20.810 [DEBUG - New I/O worker #57] (Connection.java:691) [peer master-127.30.191.61:43515(127.30.191.61:43515)] cleaning up while in state READY due to: connection disconnected 08:29:20.813 [DEBUG - New I/O worker #56] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:20.816 [DEBUG - New I/O worker #56] (Connection.java:691) [peer master-127.30.191.62:35879(127.30.191.62:35879)] cleaning up while in state READY due to: connection disconnected 08:29:20.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.817433 31484 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 31686 08:29:20.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.823232 31484 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 31829 08:29:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.829720 31484 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 31970 08:29:20.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.834328 31484 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 31493 08:29:20.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.838361 31484 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 31557 08:29:20.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.842228 31484 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 31623 08:29:20.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:20Z chronyd exiting 08:29:20.870 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720160870 08:29:20.873 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:20.874 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:20.874 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:20.874 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:20.875 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:20.876 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179" hms_mode: NONE mini_kdc_options { } } 08:29:20.958 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:20.959 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:20.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:20.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:20Z Disabled control of system clock 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:20.977059 32156 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/wal 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/data 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.62:37543 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.62 08:29:20.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/logs 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/data/info.pb 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:20.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:20.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:20.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:20.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:20.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:20.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:20.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:21.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:21.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.041474 32165 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:21.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.041709 32165 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:21.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.042711 32165 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:21.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.042742 32165 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:21.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.042750 32165 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:21.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.042759 32165 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:21.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.044672 32165 master_main.cc:98] Master server non-default flags: 08:29:21.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/data 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/wal 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.62:37543 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/data/info.pb 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.62 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.32165 08:29:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/logs 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:21.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.055480 32165 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:21.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.058813 32165 hybrid_clock.cc:181] HybridClock initialized: now 1573720161058749 us; error 61 us; skew 500 ppm 08:29:21.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.059428 32165 fs_manager.cc:261] Metadata directory not provided 08:29:21.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.059475 32165 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:21.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.059726 32165 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:21.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.059756 32165 server_base.cc:453] Attempting to create new FS layout instead 08:29:21.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.061867 32165 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/data/instance: 08:29:21.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "49c47225dca741599b9860984026e3d9" 08:29:21.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.062136 32165 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/wal/instance: 08:29:21.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "49c47225dca741599b9860984026e3d9" 08:29:21.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.067569 32165 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s 08:29:21.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.068416 32165 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:21.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.068907 32165 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.072127 32165 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.072219 32165 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/wal 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "49c47225dca741599b9860984026e3d9" 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.072299 32165 fs_report.cc:352] FS layout report 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/wal 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/wal 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/data/data 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:21.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.122251 32165 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:21.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.128046 32165 rpc_server.cc:211] RPC server started. Bound to: 127.31.103.62:37543 08:29:21.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.129104 32165 webserver.cc:382] Webserver started at http://127.31.103.62:44363/ using document root and password file 08:29:21.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.129750 32165 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-0/data/info.pb 08:29:21.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.132464 32156 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 32165 08:29:21.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.132748 32226 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:21.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.132942 32156 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/wal 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/data 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.61:44489 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.61 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/logs 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/data/info.pb 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:21.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.137852 32226 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.148489 32226 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.149354 32226 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.31.103.61:44489: Network error: Client connection negotiation failed: client connection to 127.31.103.61:44489: connect: Connection refused (error 111) 08:29:21.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.168639 32226 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } attempt: 1 08:29:21.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.169942 32226 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.31.103.61:44489: Network error: Client connection negotiation failed: client connection to 127.31.103.61:44489: connect: Connection refused (error 111) 08:29:21.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:21.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.193675 32227 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:21.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.193886 32227 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:21.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.194823 32227 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:21.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.194849 32227 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:21.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.194856 32227 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:21.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.194871 32227 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:21.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.196630 32227 master_main.cc:98] Master server non-default flags: 08:29:21.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/data 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/wal 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.61:44489 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/data/info.pb 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.61 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.32227 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/logs 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:21.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:21.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:21.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:21.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:21.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:21.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.203791 32227 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:21.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.204964 32227 hybrid_clock.cc:181] HybridClock initialized: now 1573720161204917 us; error 54 us; skew 500 ppm 08:29:21.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.205447 32227 fs_manager.cc:261] Metadata directory not provided 08:29:21.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.205492 32227 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:21.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.205698 32227 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:21.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.205726 32227 server_base.cc:453] Attempting to create new FS layout instead 08:29:21.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.207531 32227 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/data/instance: 08:29:21.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "f91d3aca6add45be97073daac62d7c74" 08:29:21.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.207798 32227 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/wal/instance: 08:29:21.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "f91d3aca6add45be97073daac62d7c74" 08:29:21.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.212960 32227 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s 08:29:21.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.213572 32227 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:21.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.213953 32227 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.217161 32227 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.217247 32227 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/wal 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "f91d3aca6add45be97073daac62d7c74" 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.217322 32227 fs_report.cc:352] FS layout report 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/wal 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/wal 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/data/data 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:21.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.218147 32226 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } attempt: 2 08:29:21.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.219171 32226 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.31.103.61:44489: Network error: Client connection negotiation failed: client connection to 127.31.103.61:44489: connect: Connection refused (error 111) 08:29:21.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.248903 32227 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:21.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.254195 32227 rpc_server.cc:211] RPC server started. Bound to: 127.31.103.61:44489 08:29:21.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.254945 32227 webserver.cc:382] Webserver started at http://127.31.103.61:39137/ using document root and password file 08:29:21.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.255425 32227 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-1/data/info.pb 08:29:21.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.258160 32290 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:21.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.260607 32156 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 32227 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.261128 32156 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/wal 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/data 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.60:39681 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.60 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/logs 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/data/info.pb 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.261796 32290 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.271174 32290 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.276595 32290 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.277299 32290 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.31.103.60:39681: Network error: Client connection negotiation failed: client connection to 127.31.103.60:39681: connect: Connection refused (error 111) 08:29:21.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.296561 32290 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } attempt: 1 08:29:21.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.297534 32290 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.31.103.60:39681: Network error: Client connection negotiation failed: client connection to 127.31.103.60:39681: connect: Connection refused (error 111) 08:29:21.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:21.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.327566 32291 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:21.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.327818 32291 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:21.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.328769 32291 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:21.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.328826 32291 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:21.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.328835 32291 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:21.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.328843 32291 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:21.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.330374 32226 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } attempt: 3 08:29:21.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.330866 32291 master_main.cc:98] Master server non-default flags: 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/data 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/wal 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.60:39681 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/data/info.pb 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.60 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.32291 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/logs 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:21.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:21.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:21.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:21.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.335130 32226 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.335871 32226 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.31.103.60:39681: Network error: Client connection negotiation failed: client connection to 127.31.103.60:39681: connect: Connection refused (error 111) 08:29:21.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.341828 32291 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:21.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.343047 32291 hybrid_clock.cc:181] HybridClock initialized: now 1573720161343009 us; error 30 us; skew 500 ppm 08:29:21.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.343683 32291 fs_manager.cc:261] Metadata directory not provided 08:29:21.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.343739 32291 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:21.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.344053 32291 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:21.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.344084 32291 server_base.cc:453] Attempting to create new FS layout instead 08:29:21.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.345772 32290 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } attempt: 2 08:29:21.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.346401 32291 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/data/instance: 08:29:21.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "73acac9b24134e639415b66a0292b448" 08:29:21.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.346731 32291 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/wal/instance: 08:29:21.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "73acac9b24134e639415b66a0292b448" 08:29:21.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.346805 32290 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.31.103.60:39681: Network error: Client connection negotiation failed: client connection to 127.31.103.60:39681: connect: Connection refused (error 111) 08:29:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.352350 32291 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s 08:29:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.353087 32291 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.353513 32291 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:21.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.356704 32291 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s 08:29:21.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.356858 32291 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/wal 08:29:21.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "73acac9b24134e639415b66a0292b448" 08:29:21.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.356971 32291 fs_report.cc:352] FS layout report 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/wal 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/wal 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/data/data 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:21.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:21.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.400099 32226 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } attempt: 1 08:29:21.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.401242 32226 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.31.103.60:39681: Network error: Client connection negotiation failed: client connection to 127.31.103.60:39681: connect: Connection refused (error 111) 08:29:21.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.417464 32291 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.422811 32291 rpc_server.cc:211] RPC server started. Bound to: 127.31.103.60:39681 08:29:21.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.423776 32291 webserver.cc:382] Webserver started at http://127.31.103.60:40805/ using document root and password file 08:29:21.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.424346 32291 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/master-2/data/info.pb 08:29:21.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.427109 32357 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:21.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.428369 32156 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 32291 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.429062 32156 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/wal 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/data 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.1:0 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.31.103.1 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.1 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/logs 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/data/info.pb 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.430467 32357 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.439708 32357 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.443784 32357 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } has no permanent_uuid. Determining permanent_uuid... 08:29:21.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.450783 32357 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448: Bootstrap starting. 08:29:21.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.452821 32357 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448: No blocks or log segments found. Creating new log. 08:29:21.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.453634 32357 log.cc:558] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448: Log is configured to *not* fsync() on all Append() calls 08:29:21.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.455274 32357 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448: No bootstrap required, opened a new log 08:29:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.458031 32290 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } attempt: 3 08:29:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.458761 32357 raft_consensus.cc:333] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.459020 32357 raft_consensus.cc:359] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:21.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.459090 32357 raft_consensus.cc:698] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73acac9b24134e639415b66a0292b448, State: Initialized, Role: FOLLOWER 08:29:21.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.459616 32357 consensus_queue.cc:228] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.459995 32357 sys_catalog.cc:340] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.460039 32357 sys_catalog.cc:343] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.460495 32362 sys_catalog.cc:340] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.460536 32362 sys_catalog.cc:343] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.460983 32357 sys_catalog.cc:428] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: configured and running, proceeding with master startup. 08:29:21.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.463871 32363 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:21.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.463912 32363 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:21.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.468566 32290 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74: Bootstrap starting. 08:29:21.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.471526 32290 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74: No blocks or log segments found. Creating new log. 08:29:21.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.472702 32290 log.cc:558] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74: Log is configured to *not* fsync() on all Append() calls 08:29:21.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.478168 32290 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74: No bootstrap required, opened a new log 08:29:21.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.480473 32226 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } attempt: 2 08:29:21.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:21.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.481155 32358 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:21.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.481395 32358 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:21.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.482353 32290 raft_consensus.cc:333] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.482615 32358 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:21.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.482641 32290 raft_consensus.cc:359] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:21.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.482692 32290 raft_consensus.cc:698] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d3aca6add45be97073daac62d7c74, State: Initialized, Role: FOLLOWER 08:29:21.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.483064 32358 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.103.1 08:29:21.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.483306 32290 consensus_queue.cc:228] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.483906 32290 sys_catalog.cc:340] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.484086 32290 sys_catalog.cc:343] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.485015 32366 sys_catalog.cc:340] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.485180 32366 sys_catalog.cc:343] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.485404 32290 sys_catalog.cc:428] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: configured and running, proceeding with master startup. 08:29:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.485529 32358 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/data 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/wal 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.1:0 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/data/info.pb 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.1 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.32358 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.31.103.1 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/logs 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:21.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:21.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.488992 32226 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9: Bootstrap starting. 08:29:21.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.491379 32226 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9: No blocks or log segments found. Creating new log. 08:29:21.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.491734 32370 catalog_manager.cc:1159] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:21.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.491775 32370 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:21.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.492327 32226 log.cc:558] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9: Log is configured to *not* fsync() on all Append() calls 08:29:21.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.494163 32226 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9: No bootstrap required, opened a new log 08:29:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.497293 32358 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.497828 32226 raft_consensus.cc:333] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.497925 32226 raft_consensus.cc:359] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:21.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.497978 32226 raft_consensus.cc:698] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49c47225dca741599b9860984026e3d9, State: Initialized, Role: FOLLOWER 08:29:21.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.498524 32226 consensus_queue.cc:228] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.498924 32226 sys_catalog.cc:340] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.498971 32226 sys_catalog.cc:343] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.499997 32226 sys_catalog.cc:428] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: configured and running, proceeding with master startup. 08:29:21.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.500080 32246 tablet.cc:1764] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:21.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.501448 32376 sys_catalog.cc:340] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.501483 32376 sys_catalog.cc:343] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.503784 32377 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:21.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.503823 32377 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:21.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.512930 32358 hybrid_clock.cc:181] HybridClock initialized: now 1573720161512849 us; error 60 us; skew 500 ppm 08:29:21.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.513891 32358 fs_manager.cc:261] Metadata directory not provided 08:29:21.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.513975 32358 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:21.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.514326 32358 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:21.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.514369 32358 server_base.cc:453] Attempting to create new FS layout instead 08:29:21.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.517196 32358 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/data/instance: 08:29:21.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5ebcd6d3f5174380b82b8bf5d8429519" 08:29:21.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.517560 32358 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/wal/instance: 08:29:21.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5ebcd6d3f5174380b82b8bf5d8429519" 08:29:21.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.530730 32358 fs_manager.cc:508] Time spent creating directory manager: real 0.013s user 0.006s sys 0.000s 08:29:21.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.531761 32358 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:21.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.532374 32358 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.536937 32358 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.537106 32358 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/wal 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "5ebcd6d3f5174380b82b8bf5d8429519" 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.537247 32358 fs_report.cc:352] FS layout report 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/wal 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/wal 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/data/data 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:21.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:21.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:21.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:21.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:21.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:21.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:21.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.569347 32358 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:21.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.570964 32358 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:21.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.571004 32358 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.581766 32358 rpc_server.cc:211] RPC server started. Bound to: 127.31.103.1:41977 08:29:21.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.582852 32358 webserver.cc:382] Webserver started at http://127.31.103.1:36797/ using document root and password file 08:29:21.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.583518 32358 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-0/data/info.pb 08:29:21.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.584769 32156 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 32358 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.585403 32156 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/wal 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/data 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.2:0 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.31.103.2 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.2 08:29:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/logs 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/data/info.pb 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.597023 32500 heartbeater.cc:322] Connected to a master server at 127.31.103.60:39681 08:29:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.597175 32500 heartbeater.cc:406] Registering TS with master... 08:29:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.597635 32500 heartbeater.cc:455] Master 127.31.103.60:39681 requested a full tablet report, sending... 08:29:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.598320 32501 heartbeater.cc:322] Connected to a master server at 127.31.103.61:44489 08:29:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.598388 32501 heartbeater.cc:406] Registering TS with master... 08:29:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.598634 32501 heartbeater.cc:455] Master 127.31.103.61:44489 requested a full tablet report, sending... 08:29:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.598928 32322 ts_manager.cc:191] Registered new tserver with Master: 5ebcd6d3f5174380b82b8bf5d8429519 (127.31.103.1:41977) 08:29:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.599939 32257 ts_manager.cc:191] Registered new tserver with Master: 5ebcd6d3f5174380b82b8bf5d8429519 (127.31.103.1:41977) 08:29:21.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.601758 32502 heartbeater.cc:322] Connected to a master server at 127.31.103.62:37543 08:29:21.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.601811 32502 heartbeater.cc:406] Registering TS with master... 08:29:21.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.601963 32502 heartbeater.cc:455] Master 127.31.103.62:37543 requested a full tablet report, sending... 08:29:21.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.602962 32192 ts_manager.cc:191] Registered new tserver with Master: 5ebcd6d3f5174380b82b8bf5d8429519 (127.31.103.1:41977) 08:29:21.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.623608 32182 tablet.cc:1764] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:21.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.668810 32310 tablet.cc:1764] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.677573 32362 raft_consensus.cc:465] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.677786 32362 raft_consensus.cc:487] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.678727 32362 leader_election.cc:296] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49c47225dca741599b9860984026e3d9 (127.31.103.62:37543), f91d3aca6add45be97073daac62d7c74 (127.31.103.61:44489) 08:29:21.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.679417 32203 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73acac9b24134e639415b66a0292b448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49c47225dca741599b9860984026e3d9" is_pre_election: true 08:29:21.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.679661 32203 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73acac9b24134e639415b66a0292b448 in term 0. 08:29:21.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.679803 32267 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73acac9b24134e639415b66a0292b448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d3aca6add45be97073daac62d7c74" is_pre_election: true 08:29:21.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.679993 32267 raft_consensus.cc:2355] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73acac9b24134e639415b66a0292b448 in term 0. 08:29:21.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.680356 32302 leader_election.cc:310] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c47225dca741599b9860984026e3d9, 73acac9b24134e639415b66a0292b448; no voters: 08:29:21.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.680743 32362 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:21.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.680832 32362 raft_consensus.cc:465] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:21.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.680864 32362 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 0 FOLLOWER]: Advancing to term 1 08:29:21.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.681787 32362 raft_consensus.cc:487] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.682077 32362 leader_election.cc:296] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [CANDIDATE]: Term 1 election: Requested vote from peers 49c47225dca741599b9860984026e3d9 (127.31.103.62:37543), f91d3aca6add45be97073daac62d7c74 (127.31.103.61:44489) 08:29:21.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.682618 32203 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73acac9b24134e639415b66a0292b448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49c47225dca741599b9860984026e3d9" 08:29:21.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.682724 32203 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [term 0 FOLLOWER]: Advancing to term 1 08:29:21.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.684123 32203 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73acac9b24134e639415b66a0292b448 in term 1. 08:29:21.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.684427 32267 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73acac9b24134e639415b66a0292b448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d3aca6add45be97073daac62d7c74" 08:29:21.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.684514 32302 leader_election.cc:310] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c47225dca741599b9860984026e3d9, 73acac9b24134e639415b66a0292b448; no voters: 08:29:21.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.684525 32267 raft_consensus.cc:2901] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [term 0 FOLLOWER]: Advancing to term 1 08:29:21.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.684725 32362 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 1 FOLLOWER]: Leader election won for term 1 08:29:21.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.684995 32362 raft_consensus.cc:660] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [term 1 LEADER]: Becoming Leader. State: Replica: 73acac9b24134e639415b66a0292b448, State: Running, Role: LEADER 08:29:21.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.685346 32362 consensus_queue.cc:205] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } 08:29:21.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.685698 32267 raft_consensus.cc:2355] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73acac9b24134e639415b66a0292b448 in term 1. 08:29:21.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.687557 32508 sys_catalog.cc:340] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73acac9b24134e639415b66a0292b448. Latest consensus state: current_term: 1 leader_uuid: "73acac9b24134e639415b66a0292b448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.687613 32508 sys_catalog.cc:343] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: This master's current role is: LEADER 08:29:21.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.688071 32510 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:21.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.689252 32510 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:21.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.698354 32267 raft_consensus.cc:1177] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [term 1 FOLLOWER]: Refusing update from remote peer 73acac9b24134e639415b66a0292b448: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:21.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.699082 32508 consensus_queue.cc:981] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:21.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.699249 32203 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [term 1 FOLLOWER]: Refusing update from remote peer 73acac9b24134e639415b66a0292b448: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:21.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.700093 32508 consensus_queue.cc:981] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:21.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.703537 32366 sys_catalog.cc:340] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73acac9b24134e639415b66a0292b448. Latest consensus state: current_term: 1 leader_uuid: "73acac9b24134e639415b66a0292b448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.703581 32366 sys_catalog.cc:343] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.704535 32376 sys_catalog.cc:340] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73acac9b24134e639415b66a0292b448. Latest consensus state: current_term: 1 leader_uuid: "73acac9b24134e639415b66a0292b448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.704581 32376 sys_catalog.cc:343] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.706912 32362 sys_catalog.cc:340] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73acac9b24134e639415b66a0292b448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.706950 32362 sys_catalog.cc:343] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: This master's current role is: LEADER 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.707396 32362 sys_catalog.cc:340] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73acac9b24134e639415b66a0292b448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.707417 32362 sys_catalog.cc:343] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448 [sys.catalog]: This master's current role is: LEADER 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.708381 32376 sys_catalog.cc:340] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73acac9b24134e639415b66a0292b448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.708410 32376 sys_catalog.cc:343] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.708881 32510 catalog_manager.cc:985] Generated new certificate authority record 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.708887 32366 sys_catalog.cc:340] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73acac9b24134e639415b66a0292b448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c47225dca741599b9860984026e3d9" member_type: VOTER last_known_addr { host: "127.31.103.62" port: 37543 } } peers { permanent_uuid: "f91d3aca6add45be97073daac62d7c74" member_type: VOTER last_known_addr { host: "127.31.103.61" port: 44489 } } peers { permanent_uuid: "73acac9b24134e639415b66a0292b448" member_type: VOTER last_known_addr { host: "127.31.103.60" port: 39681 } } } 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.708907 32366 sys_catalog.cc:343] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74 [sys.catalog]: This master's current role is: FOLLOWER 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.709375 32514 mvcc.cc:203] Tried to move safe_time back from 6445957782309752832 to 6445957782265147392. Current Snapshot: MvccSnapshot[committed={T|T < 6445957782309752832}] 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.709458 32512 mvcc.cc:203] Tried to move safe_time back from 6445957782309752832 to 6445957782265147392. Current Snapshot: MvccSnapshot[committed={T|T < 6445957782309752832}] 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.709762 32511 mvcc.cc:203] Tried to move safe_time back from 6445957782309752832 to 6445957782265147392. Current Snapshot: MvccSnapshot[committed={T|T < 6445957782309752832 or (T in {6445957782309752832})}] 08:29:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.710232 32510 catalog_manager.cc:1110] Loading token signing keys... 08:29:21.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.726016 32510 catalog_manager.cc:4455] T 00000000000000000000000000000000 P 73acac9b24134e639415b66a0292b448: Generated new TSK 0 08:29:21.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.726579 32510 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:21.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:21.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.763825 32504 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:21.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.764070 32504 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:21.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.772029 32504 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:21.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.772125 32504 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.103.2 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.774205 32504 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/data 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/wal 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.2:0 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/data/info.pb 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.2 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.32504 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.31.103.2 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/logs 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:21.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:21.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.790967 32504 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:21.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.792183 32504 hybrid_clock.cc:181] HybridClock initialized: now 1573720161792155 us; error 27 us; skew 500 ppm 08:29:21.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.792840 32504 fs_manager.cc:261] Metadata directory not provided 08:29:21.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.792899 32504 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:21.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.793184 32504 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:21.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.793216 32504 server_base.cc:453] Attempting to create new FS layout instead 08:29:21.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.795058 32504 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/data/instance: 08:29:21.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "b89b176c4ac949f4b65b393f0ff20478" 08:29:21.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.795401 32504 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/wal/instance: 08:29:21.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "b89b176c4ac949f4b65b393f0ff20478" 08:29:21.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.800232 32504 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s 08:29:21.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.800923 32504 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:21.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.801424 32504 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.804406 32504 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s 08:29:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.804522 32504 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/wal 08:29:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "b89b176c4ac949f4b65b393f0ff20478" 08:29:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.804630 32504 fs_report.cc:352] FS layout report 08:29:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/wal 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/wal 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/data/data 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:21.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.844699 32504 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.846011 32504 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.846045 32504 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.853595 32504 rpc_server.cc:211] RPC server started. Bound to: 127.31.103.2:37999 08:29:21.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.854537 32504 webserver.cc:382] Webserver started at http://127.31.103.2:33059/ using document root and password file 08:29:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.855124 32504 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-1/data/info.pb 08:29:21.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.859454 32156 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 32504 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.860106 32156 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/wal 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/data 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.3:0 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.31.103.3 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.3 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/logs 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/data/info.pb 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865198 32643 heartbeater.cc:322] Connected to a master server at 127.31.103.60:39681 08:29:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865253 32645 heartbeater.cc:322] Connected to a master server at 127.31.103.62:37543 08:29:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865291 32644 heartbeater.cc:322] Connected to a master server at 127.31.103.61:44489 08:29:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865348 32645 heartbeater.cc:406] Registering TS with master... 08:29:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865348 32644 heartbeater.cc:406] Registering TS with master... 08:29:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865350 32643 heartbeater.cc:406] Registering TS with master... 08:29:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865901 32643 heartbeater.cc:455] Master 127.31.103.60:39681 requested a full tablet report, sending... 08:29:21.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865998 32644 heartbeater.cc:455] Master 127.31.103.61:44489 requested a full tablet report, sending... 08:29:21.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.865902 32645 heartbeater.cc:455] Master 127.31.103.62:37543 requested a full tablet report, sending... 08:29:21.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.867097 32322 ts_manager.cc:191] Registered new tserver with Master: b89b176c4ac949f4b65b393f0ff20478 (127.31.103.2:37999) 08:29:21.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.867154 32257 ts_manager.cc:191] Registered new tserver with Master: b89b176c4ac949f4b65b393f0ff20478 (127.31.103.2:37999) 08:29:21.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.867213 32192 ts_manager.cc:191] Registered new tserver with Master: b89b176c4ac949f4b65b393f0ff20478 (127.31.103.2:37999) 08:29:21.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.868640 32322 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.31.103.2:56393 08:29:21.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:21.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.910950 32650 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:21.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.911175 32650 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:21.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.912029 32650 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:21.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:21.912089 32650 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.103.3 08:29:21.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.913707 32650 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:21.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:21.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.31.103.20:43163 08:29:21.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:21.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:21.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/data 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/wal 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.31.103.3:0 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/data/info.pb 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.31.103.3 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.31.103.62:37543,127.31.103.61:44489,127.31.103.60:39681 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.32650 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.31.103.3 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/logs 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.920748 32650 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:21.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.921955 32650 hybrid_clock.cc:181] HybridClock initialized: now 1573720161921921 us; error 36 us; skew 500 ppm 08:29:21.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.922426 32650 fs_manager.cc:261] Metadata directory not provided 08:29:21.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.922479 32650 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:21.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.922703 32650 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:21.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.922731 32650 server_base.cc:453] Attempting to create new FS layout instead 08:29:21.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.924504 32650 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/data/instance: 08:29:21.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" 08:29:21.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.924746 32650 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/wal/instance: 08:29:21.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" 08:29:21.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.930316 32650 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s 08:29:21.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.931021 32650 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:21.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.931473 32650 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:21.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.934552 32650 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:21.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.934715 32650 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/wal 08:29:21.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" 08:29:21.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:21 on dist-test-slave-dist-test-slave-05kx" 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.934872 32650 fs_report.cc:352] FS layout report 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/wal 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/wal 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/data/data 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:21.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.974802 32650 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:21.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.975919 32650 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:21.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.975950 32650 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:21.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.983382 32650 rpc_server.cc:211] RPC server started. Bound to: 127.31.103.3:42265 08:29:21.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.984247 32650 webserver.cc:382] Webserver started at http://127.31.103.3:34449/ using document root and password file 08:29:21.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.985522 32650 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster271751051660020179/ts-2/data/info.pb 08:29:21.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.988497 32156 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 32650 08:29:21.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.996008 304 heartbeater.cc:322] Connected to a master server at 127.31.103.61:44489 08:29:21.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.996040 303 heartbeater.cc:322] Connected to a master server at 127.31.103.60:39681 08:29:21.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.996150 303 heartbeater.cc:406] Registering TS with master... 08:29:21.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.996577 303 heartbeater.cc:455] Master 127.31.103.60:39681 requested a full tablet report, sending... 08:29:21.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.996712 305 heartbeater.cc:322] Connected to a master server at 127.31.103.62:37543 08:29:21.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.996150 304 heartbeater.cc:406] Registering TS with master... 08:29:21.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.996845 305 heartbeater.cc:406] Registering TS with master... 08:29:21.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.996934 304 heartbeater.cc:455] Master 127.31.103.61:44489 requested a full tablet report, sending... 08:29:21.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.997040 305 heartbeater.cc:455] Master 127.31.103.62:37543 requested a full tablet report, sending... 08:29:21.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.997882 32192 ts_manager.cc:191] Registered new tserver with Master: 8e5e52ceafbb4f25b095b9072f3f5dbe (127.31.103.3:42265) 08:29:21.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.998050 32322 ts_manager.cc:191] Registered new tserver with Master: 8e5e52ceafbb4f25b095b9072f3f5dbe (127.31.103.3:42265) 08:29:21.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.998428 32257 ts_manager.cc:191] Registered new tserver with Master: 8e5e52ceafbb4f25b095b9072f3f5dbe (127.31.103.3:42265) 08:29:21.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:21.999065 32322 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.31.103.3:47433 08:29:22.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.009701 32156 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:22.009 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:22.010 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:22.010 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.31.103.62" port: 37543 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.31.103.61" port: 44489 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.31.103.60" port: 39681 } } } 08:29:22.011 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:22.011 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.31.103.1" port: 41977 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.31.103.2" port: 37999 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.31.103.3" port: 42265 } } } 08:29:22.012 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:22.016 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:22.022 [DEBUG - New I/O worker #64] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.31.103.60 08:29:22.022 [DEBUG - New I/O worker #66] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.31.103.62 08:29:22.022 [DEBUG - New I/O worker #65] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.31.103.61 08:29:22.028 [DEBUG - New I/O worker #65] (Negotiator.java:764) Authenticated connection [id: 0x6bc0b6e0, /127.0.0.1:57838 => /127.31.103.61:44489] using SASL/PLAIN 08:29:22.036 [DEBUG - New I/O worker #66] (Negotiator.java:764) Authenticated connection [id: 0x2e9229d1, /127.0.0.1:52950 => /127.31.103.62:37543] using SASL/PLAIN 08:29:22.036 [DEBUG - New I/O worker #64] (Negotiator.java:764) Authenticated connection [id: 0x28ceefcf, /127.0.0.1:47344 => /127.31.103.60:39681] using SASL/PLAIN 08:29:22.039 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:22.039 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=22), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.103.60:39681, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.103.61:44489, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.103.62:37543, [20ms] Sub RPC ConnectToMaster: received response from server master-127.31.103.61:44489: OK, [20ms] Sub RPC ConnectToMaster: received response from server master-127.31.103.62:37543: OK, [21ms] Sub RPC ConnectToMaster: received response from server master-127.31.103.60:39681: OK, deferred=null) after lookup 08:29:22.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.042678 32322 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47344: 08:29:22.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:22.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:22.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:22.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:22.043581 32322 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:22.051 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:777) Opened table 8cc0128ba9294546975e3a8f7d12fb68 08:29:22.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.062224 32579 tablet_service.cc:1023] Processing CreateTablet for tablet 71f52563ebb2403c80f5fd5283675b59 (table=org.apache.kudu.client.TestAsyncKuduSession [id=8cc0128ba9294546975e3a8f7d12fb68]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:22.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.062799 32579 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 71f52563ebb2403c80f5fd5283675b59. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:22.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.063977 32708 tablet_service.cc:1023] Processing CreateTablet for tablet 71f52563ebb2403c80f5fd5283675b59 (table=org.apache.kudu.client.TestAsyncKuduSession [id=8cc0128ba9294546975e3a8f7d12fb68]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:22.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.064385 32708 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 71f52563ebb2403c80f5fd5283675b59. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:22.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.064581 32420 tablet_service.cc:1023] Processing CreateTablet for tablet 71f52563ebb2403c80f5fd5283675b59 (table=org.apache.kudu.client.TestAsyncKuduSession [id=8cc0128ba9294546975e3a8f7d12fb68]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:22.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.065201 32420 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 71f52563ebb2403c80f5fd5283675b59. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:22.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.070436 330 tablet_bootstrap.cc:439] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478: Bootstrap starting. 08:29:22.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.072237 330 tablet_bootstrap.cc:590] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478: No blocks or log segments found. Creating new log. 08:29:22.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.073155 331 tablet_bootstrap.cc:439] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe: Bootstrap starting. 08:29:22.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.074517 331 tablet_bootstrap.cc:590] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe: No blocks or log segments found. Creating new log. 08:29:22.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.075194 331 log.cc:558] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe: Log is configured to *not* fsync() on all Append() calls 08:29:22.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.075857 332 tablet_bootstrap.cc:439] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519: Bootstrap starting. 08:29:22.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.077288 332 tablet_bootstrap.cc:590] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519: No blocks or log segments found. Creating new log. 08:29:22.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.078105 332 log.cc:558] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519: Log is configured to *not* fsync() on all Append() calls 08:29:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.079540 330 log.cc:558] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478: Log is configured to *not* fsync() on all Append() calls 08:29:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.079644 331 tablet_bootstrap.cc:439] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe: No bootstrap required, opened a new log 08:29:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.079818 331 ts_tablet_manager.cc:1096] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s 08:29:22.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.080915 332 tablet_bootstrap.cc:439] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519: No bootstrap required, opened a new log 08:29:22.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.081070 332 ts_tablet_manager.cc:1096] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s 08:29:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.083132 331 raft_consensus.cc:333] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.083235 331 raft_consensus.cc:359] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.083287 331 raft_consensus.cc:698] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5e52ceafbb4f25b095b9072f3f5dbe, State: Initialized, Role: FOLLOWER 08:29:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.083753 331 consensus_queue.cc:228] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.083806 332 raft_consensus.cc:333] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.083874 332 raft_consensus.cc:359] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.083909 332 raft_consensus.cc:698] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ebcd6d3f5174380b82b8bf5d8429519, State: Initialized, Role: FOLLOWER 08:29:22.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.084349 303 heartbeater.cc:447] Master 127.31.103.60:39681 was elected leader, sending a full tablet report... 08:29:22.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.085162 330 tablet_bootstrap.cc:439] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478: No bootstrap required, opened a new log 08:29:22.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.085330 330 ts_tablet_manager.cc:1096] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s 08:29:22.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.087626 331 ts_tablet_manager.cc:1124] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s 08:29:22.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.088129 330 raft_consensus.cc:333] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.088222 330 raft_consensus.cc:359] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:22.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.088260 330 raft_consensus.cc:698] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89b176c4ac949f4b65b393f0ff20478, State: Initialized, Role: FOLLOWER 08:29:22.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.088613 330 consensus_queue.cc:228] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.089107 332 consensus_queue.cc:228] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.090391 332 ts_tablet_manager.cc:1124] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s 08:29:22.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.090965 32643 heartbeater.cc:447] Master 127.31.103.60:39681 was elected leader, sending a full tablet report... 08:29:22.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.092031 32322 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.31.103.1:39581 08:29:22.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.093164 330 ts_tablet_manager.cc:1124] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478: Time spent starting tablet: real 0.008s user 0.000s sys 0.004s 08:29:22.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.093652 32500 heartbeater.cc:447] Master 127.31.103.60:39681 was elected leader, sending a full tablet report... 08:29:22.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:22.106529 32646 tablet.cc:1764] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:22.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:22.237268 307 tablet.cc:1764] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:22.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.279155 338 raft_consensus.cc:465] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:22.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.279415 338 raft_consensus.cc:487] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.280596 338 leader_election.cc:296] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b89b176c4ac949f4b65b393f0ff20478 (127.31.103.2:37999), 8e5e52ceafbb4f25b095b9072f3f5dbe (127.31.103.3:42265) 08:29:22.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.283496 337 raft_consensus.cc:465] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:22.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.283676 337 raft_consensus.cc:487] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.284580 337 leader_election.cc:296] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ebcd6d3f5174380b82b8bf5d8429519 (127.31.103.1:41977), 8e5e52ceafbb4f25b095b9072f3f5dbe (127.31.103.3:42265) 08:29:22.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.287019 32599 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "71f52563ebb2403c80f5fd5283675b59" candidate_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89b176c4ac949f4b65b393f0ff20478" is_pre_election: true 08:29:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.287170 32599 raft_consensus.cc:2355] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ebcd6d3f5174380b82b8bf5d8429519 in term 0. 08:29:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.287629 32728 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "71f52563ebb2403c80f5fd5283675b59" candidate_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" is_pre_election: true 08:29:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.287659 32384 leader_election.cc:310] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ebcd6d3f5174380b82b8bf5d8429519, b89b176c4ac949f4b65b393f0ff20478; no voters: 08:29:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.287778 32728 raft_consensus.cc:2355] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ebcd6d3f5174380b82b8bf5d8429519 in term 0. 08:29:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.288448 338 raft_consensus.cc:2649] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.288509 338 raft_consensus.cc:465] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.288538 338 raft_consensus.cc:2901] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 0 FOLLOWER]: Advancing to term 1 08:29:22.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.289163 32455 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "71f52563ebb2403c80f5fd5283675b59" candidate_uuid: "b89b176c4ac949f4b65b393f0ff20478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" is_pre_election: true 08:29:22.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.289330 32728 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "71f52563ebb2403c80f5fd5283675b59" candidate_uuid: "b89b176c4ac949f4b65b393f0ff20478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" is_pre_election: true 08:29:22.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.289403 32728 raft_consensus.cc:2355] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b89b176c4ac949f4b65b393f0ff20478 in term 0. 08:29:22.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.289775 32530 leader_election.cc:310] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e5e52ceafbb4f25b095b9072f3f5dbe, b89b176c4ac949f4b65b393f0ff20478; no voters: 08:29:22.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.290015 338 raft_consensus.cc:487] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.290077 337 raft_consensus.cc:2649] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:22.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.290128 337 raft_consensus.cc:465] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:22.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.290153 337 raft_consensus.cc:2901] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 0 FOLLOWER]: Advancing to term 1 08:29:22.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.290203 32455 raft_consensus.cc:2285] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b89b176c4ac949f4b65b393f0ff20478 in current term 1: Already voted for candidate 5ebcd6d3f5174380b82b8bf5d8429519 in this term. 08:29:22.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.290745 32599 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "71f52563ebb2403c80f5fd5283675b59" candidate_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89b176c4ac949f4b65b393f0ff20478" 08:29:22.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.291100 32728 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "71f52563ebb2403c80f5fd5283675b59" candidate_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" 08:29:22.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.291169 32728 raft_consensus.cc:2901] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 0 FOLLOWER]: Advancing to term 1 08:29:22.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.291297 337 raft_consensus.cc:487] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.291416 32599 raft_consensus.cc:2285] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ebcd6d3f5174380b82b8bf5d8429519 in current term 1: Already voted for candidate b89b176c4ac949f4b65b393f0ff20478 in this term. 08:29:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.291960 337 leader_election.cc:296] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [CANDIDATE]: Term 1 election: Requested vote from peers 5ebcd6d3f5174380b82b8bf5d8429519 (127.31.103.1:41977), 8e5e52ceafbb4f25b095b9072f3f5dbe (127.31.103.3:42265) 08:29:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.292225 32728 raft_consensus.cc:2355] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ebcd6d3f5174380b82b8bf5d8429519 in term 1. 08:29:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.292315 32455 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "71f52563ebb2403c80f5fd5283675b59" candidate_uuid: "b89b176c4ac949f4b65b393f0ff20478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" 08:29:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.292373 32727 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "71f52563ebb2403c80f5fd5283675b59" candidate_uuid: "b89b176c4ac949f4b65b393f0ff20478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" 08:29:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.292382 32455 raft_consensus.cc:2285] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b89b176c4ac949f4b65b393f0ff20478 in current term 1: Already voted for candidate 5ebcd6d3f5174380b82b8bf5d8429519 in this term. 08:29:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.292455 32727 raft_consensus.cc:2285] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b89b176c4ac949f4b65b393f0ff20478 in current term 1: Already voted for candidate 5ebcd6d3f5174380b82b8bf5d8429519 in this term. 08:29:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.292609 32383 leader_election.cc:310] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ebcd6d3f5174380b82b8bf5d8429519, 8e5e52ceafbb4f25b095b9072f3f5dbe; no voters: b89b176c4ac949f4b65b393f0ff20478 08:29:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.292928 338 leader_election.cc:296] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [CANDIDATE]: Term 1 election: Requested vote from peers b89b176c4ac949f4b65b393f0ff20478 (127.31.103.2:37999), 8e5e52ceafbb4f25b095b9072f3f5dbe (127.31.103.3:42265) 08:29:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.293035 32529 leader_election.cc:310] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b89b176c4ac949f4b65b393f0ff20478; no voters: 5ebcd6d3f5174380b82b8bf5d8429519, 8e5e52ceafbb4f25b095b9072f3f5dbe 08:29:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.293067 342 raft_consensus.cc:2649] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 1 FOLLOWER]: Leader election won for term 1 08:29:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.293159 342 raft_consensus.cc:660] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [term 1 LEADER]: Becoming Leader. State: Replica: 5ebcd6d3f5174380b82b8bf5d8429519, State: Running, Role: LEADER 08:29:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.293205 337 raft_consensus.cc:2597] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority 08:29:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.293490 342 consensus_queue.cc:205] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } } 08:29:22.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.296638 32322 catalog_manager.cc:4143] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 reported cstate change: term changed from 0 to 1, leader changed from to 5ebcd6d3f5174380b82b8bf5d8429519 (127.31.103.1). New cstate: current_term: 1 leader_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebcd6d3f5174380b82b8bf5d8429519" member_type: VOTER last_known_addr { host: "127.31.103.1" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 } health_report { overall_health: UNKNOWN } } } 08:29:22.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:22.339196 32503 tablet.cc:1764] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:22.429 [DEBUG - New I/O worker #64] (NetUtil.java:107) Resolved IP of `127.31.103.1' to /127.31.103.1 in 654049ns 08:29:22.432 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.433 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.433 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.433 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.434 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.434 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.435 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.435 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.435 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.436 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.437 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.437 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.438 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.438 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.438 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.439 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.439 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.439 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.440 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.440 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.441 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.441 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.442 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.442 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.443 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.443 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.443 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.444 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.444 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.444 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.445 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.446 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.446 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.446 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.447 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.447 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.448 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.448 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.449 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.449 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.450 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.450 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.450 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.450 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.451 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.451 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.452 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.452 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@b85b0ed, flushNotification=Deferred@88231917(state=PENDING, result=null, callback=, errback=)} 08:29:22.453 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.453 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.453 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.454 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.454 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.455 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.455 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.455 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.456 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.456 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.457 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.457 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.457 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.458 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.458 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.459 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.459 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.459 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.460 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.460 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.460 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.461 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.462 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.462 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.462 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.463 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.463 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@17ddb9d, flushNotification=Deferred@1149191638(state=PENDING, result=null, callback=, errback=)} 08:29:22.463 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.464 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.464 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.464 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.465 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.465 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.465 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.466 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.466 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.466 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.467 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.467 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.468 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.468 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.468 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.469 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.469 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.469 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.470 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.472 [DEBUG - New I/O worker #64] (NetUtil.java:107) Resolved IP of `127.31.103.3' to /127.31.103.3 in 2300284ns 08:29:22.473 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.473 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.474 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.474 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.474 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.475 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.475 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.476 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.476 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.476 [DEBUG - New I/O worker #64] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.495786 32370 catalog_manager.cc:1157] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74: acquiring CA information for follower catalog manager: success 08:29:22.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.499684 32370 catalog_manager.cc:1185] T 00000000000000000000000000000000 P f91d3aca6add45be97073daac62d7c74: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:22.501 [DEBUG - New I/O worker #67] (Negotiator.java:764) Authenticated connection [id: 0x93a32ad8, /127.0.0.1:44192 => /127.31.103.1:41977] using TOKEN/null 08:29:22.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.506492 32377 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9: acquiring CA information for follower catalog manager: success 08:29:22.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.507385 32377 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 49c47225dca741599b9860984026e3d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:22.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.517400 32599 raft_consensus.cc:1177] T 71f52563ebb2403c80f5fd5283675b59 P b89b176c4ac949f4b65b393f0ff20478 [term 1 FOLLOWER]: Refusing update from remote peer 5ebcd6d3f5174380b82b8bf5d8429519: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:22.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.517467 32727 raft_consensus.cc:1177] T 71f52563ebb2403c80f5fd5283675b59 P 8e5e52ceafbb4f25b095b9072f3f5dbe [term 1 FOLLOWER]: Refusing update from remote peer 5ebcd6d3f5174380b82b8bf5d8429519: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:22.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.518069 338 consensus_queue.cc:981] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b89b176c4ac949f4b65b393f0ff20478" member_type: VOTER last_known_addr { host: "127.31.103.2" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:22.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.518221 342 consensus_queue.cc:981] T 71f52563ebb2403c80f5fd5283675b59 P 5ebcd6d3f5174380b82b8bf5d8429519 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e5e52ceafbb4f25b095b9072f3f5dbe" member_type: VOTER last_known_addr { host: "127.31.103.3" port: 42265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:22.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.547109 347 mvcc.cc:203] Tried to move safe_time back from 6445957785662271488 to 6445957784756150272. Current Snapshot: MvccSnapshot[committed={T|T < 6445957785662271488}] 08:29:22.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.548295 345 mvcc.cc:203] Tried to move safe_time back from 6445957785662271488 to 6445957784756150272. Current Snapshot: MvccSnapshot[committed={T|T < 6445957785662271488}] 08:29:22.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:22.567076 348 mvcc.cc:203] Tried to move safe_time back from 6445957785662271488 to 6445957784756150272. Current Snapshot: MvccSnapshot[committed={T|T < 6445957785662271488}] 08:29:22.587 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@75f181ed, flushNotification=Deferred@440344061(state=PENDING, result=null, callback=, errback=)} 08:29:22.620 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2450ba99, flushNotification=Deferred@437139864(state=PENDING, result=null, callback=, errback=)} 08:29:22.648 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@63092ddd, flushNotification=Deferred@20649140(state=PENDING, result=null, callback=, errback=)} 08:29:22.724 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@201ee278, flushNotification=Deferred@1270336794(state=PENDING, result=null, callback=, errback=)} 08:29:22.769 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@617a7674, flushNotification=Deferred@943542363(state=PENDING, result=null, callback=, errback=)} 08:29:22.828 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6f676806, flushNotification=Deferred@449689581(state=PENDING, result=null, callback=, errback=)} 08:29:22.850 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@28b6bb16, flushNotification=Deferred@2052819411(state=PENDING, result=null, callback=, errback=)} 08:29:22.925 [DEBUG - Time-limited test] (AsyncKuduClient.java:2346) Learned about tablet 71f52563ebb2403c80f5fd5283675b59 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:22.925 [DEBUG - Time-limited test] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=71f52563ebb2403c80f5fd5283675b59@[5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)[L],8e5e52ceafbb4f25b095b9072f3f5dbe(127.31.103.3:42265),b89b176c4ac949f4b65b393f0ff20478(127.31.103.2:37999)]}] 08:29:22.926 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@592d4121, flushNotification=Deferred@1155411737(state=PENDING, result=null, callback=, errback=)} 08:29:23.024 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@626d3340, flushNotification=Deferred@199397378(state=PENDING, result=null, callback=, errback=)} 08:29:23.038 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@38f5ec16, flushNotification=Deferred@224836342(state=PENDING, result=null, callback=, errback=)} 08:29:23.125 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@69a6f29, flushNotification=Deferred@426220920(state=PENDING, result=null, callback=, errback=)} 08:29:23.172 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@ee5571e, flushNotification=Deferred@921496894(state=PENDING, result=null, callback=, errback=)} 08:29:23.224 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@635a3fed, flushNotification=Deferred@1190392483(state=PENDING, result=null, callback=, errback=)} 08:29:23.257 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@628a10c4, flushNotification=Deferred@870225078(state=PENDING, result=null, callback=, errback=)} 08:29:23.341 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1496077, flushNotification=Deferred@1484188695(state=PENDING, result=null, callback=, errback=)} 08:29:23.344 [DEBUG - Time-limited test] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1000, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6ac8dbed, flushNotification=Deferred@762616102(state=DONE, result=null, callback=, errback=)} 08:29:23.423 [DEBUG - New I/O worker #65] (Connection.java:691) [peer master-127.31.103.61:44489(127.31.103.61:44489)] cleaning up while in state READY due to: connection disconnected 08:29:23.426 [DEBUG - New I/O worker #66] (Connection.java:691) [peer master-127.31.103.62:37543(127.31.103.62:37543)] cleaning up while in state READY due to: connection disconnected 08:29:23.444 [DEBUG - New I/O worker #67] (Connection.java:691) [peer 5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977)] cleaning up while in state READY due to: connection disconnected 08:29:23.445 [INFO - New I/O worker #67] (AsyncKuduClient.java:2157) Invalidating location 5ebcd6d3f5174380b82b8bf5d8429519(127.31.103.1:41977) for tablet 71f52563ebb2403c80f5fd5283675b59: connection disconnected 08:29:23.448 [DEBUG - New I/O worker #64] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:23.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.448976 32383 connection.cc:562] Connection torn down before Call kudu.tserver.TabletServerService.Write from 127.0.0.1:44192 (ReqId={client: d299fcf233ce414b9a5ff9cae043630d, seq_no=18, attempt_no=1}) could send its response 08:29:23.450 [DEBUG - New I/O worker #64] (Connection.java:691) [peer master-127.31.103.60:39681(127.31.103.60:39681)] cleaning up while in state READY due to: connection disconnected 08:29:23.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.450634 32156 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 32358 08:29:23.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.459223 32156 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 32504 08:29:23.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.463840 32156 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 32650 08:29:23.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.467851 32156 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 32165 08:29:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.471707 32156 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 32227 08:29:23.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.475081 32156 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 32291 08:29:23.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:23Z chronyd exiting 08:29:23.499 [ERROR - main] (RetryRule.java:217) org.apache.kudu.client.TestAsyncKuduSession.testTabletCacheInvalidatedDuringWrites: failed attempt 1 org.apache.kudu.client.PleaseThrottleException: all buffers are currently flushing at org.apache.kudu.client.AsyncKuduSession.apply(AsyncKuduSession.java:579) ~[main/:?] at org.apache.kudu.client.TestAsyncKuduSession.testTabletCacheInvalidatedDuringWrites(TestAsyncKuduSession.java:371) ~[test/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) ~[junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) ~[junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) ~[junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) ~[junit-4.12.jar:4.12] at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) ~[junit-4.12.jar:4.12] at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) ~[junit-4.12.jar:4.12] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_141] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_141] 08:29:23.500 [ERROR - main] (RetryRule.java:239) org.apache.kudu.client.TestAsyncKuduSession.testTabletCacheInvalidatedDuringWrites: giving up after 1 attempts E08:29:23.502 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720163502 08:29:23.505 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:23.505 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:23.505 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:23.505 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:23.506 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:23.507 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064" hms_mode: NONE mini_kdc_options { } } 08:29:23.576 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:23.577 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:23.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:23.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:23Z Disabled control of system clock 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.596848 360 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/wal 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/data 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.62:32977 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.62 08:29:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/logs 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/data/info.pb 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.653360 369 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.653560 369 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.654489 369 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.654516 369 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.654525 369 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.654533 369 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.656483 369 master_main.cc:98] Master server non-default flags: 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/data 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/wal 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:23.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.62:32977 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/data/info.pb 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.62 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.369 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/logs 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:23.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.663362 369 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:23.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.664547 369 hybrid_clock.cc:181] HybridClock initialized: now 1573720163664518 us; error 40 us; skew 500 ppm 08:29:23.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.665122 369 fs_manager.cc:261] Metadata directory not provided 08:29:23.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.665174 369 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:23.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.665455 369 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:23.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.665486 369 server_base.cc:453] Attempting to create new FS layout instead 08:29:23.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.667325 369 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/data/instance: 08:29:23.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" 08:29:23.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.667640 369 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/wal/instance: 08:29:23.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" 08:29:23.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.672425 369 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s 08:29:23.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.673112 369 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:23.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.673539 369 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:23.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.676656 369 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:23.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.676872 369 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/wal 08:29:23.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.677021 369 fs_report.cc:352] FS layout report 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/wal 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/wal 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/data/data 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:23.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:23.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.698740 369 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:23.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.704723 369 rpc_server.cc:211] RPC server started. Bound to: 127.0.90.62:32977 08:29:23.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.705679 369 webserver.cc:382] Webserver started at http://127.0.90.62:44069/ using document root and password file 08:29:23.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.706254 369 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-0/data/info.pb 08:29:23.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.709228 431 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:23.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.712993 431 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } has no permanent_uuid. Determining permanent_uuid... 08:29:23.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.713877 360 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 369 08:29:23.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.714464 360 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:23.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:23.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/wal 08:29:23.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/data 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.61:38857 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.61 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/logs 08:29:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/data/info.pb 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:23.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:23.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.728704 431 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } has no permanent_uuid. Determining permanent_uuid... 08:29:23.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.729615 431 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.90.61:38857: Network error: Client connection negotiation failed: client connection to 127.0.90.61:38857: connect: Connection refused (error 111) 08:29:23.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.748898 431 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } attempt: 1 08:29:23.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.750111 431 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.90.61:38857: Network error: Client connection negotiation failed: client connection to 127.0.90.61:38857: connect: Connection refused (error 111) 08:29:23.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:23.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.781147 432 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:23.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.781402 432 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:23.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.782624 432 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:23.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.782660 432 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:23.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.782668 432 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:23.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.782677 432 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:23.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.784827 432 master_main.cc:98] Master server non-default flags: 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/data 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/wal 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.61:38857 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:23.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/data/info.pb 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.61 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.432 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/logs 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:23.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:23.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.792903 432 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:23.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.794108 432 hybrid_clock.cc:181] HybridClock initialized: now 1573720163794056 us; error 60 us; skew 500 ppm 08:29:23.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.794675 432 fs_manager.cc:261] Metadata directory not provided 08:29:23.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.794728 432 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:23.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.794960 432 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:23.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.794996 432 server_base.cc:453] Attempting to create new FS layout instead 08:29:23.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.797027 432 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/data/instance: 08:29:23.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8ae71b235dcf474da21dbb774a96a4a1" 08:29:23.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.797268 432 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/wal/instance: 08:29:23.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8ae71b235dcf474da21dbb774a96a4a1" 08:29:23.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.798301 431 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } attempt: 2 08:29:23.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.799343 431 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.90.61:38857: Network error: Client connection negotiation failed: client connection to 127.0.90.61:38857: connect: Connection refused (error 111) 08:29:23.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.802850 432 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s 08:29:23.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.803478 432 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:23.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.803905 432 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.807080 432 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.807174 432 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/wal 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8ae71b235dcf474da21dbb774a96a4a1" 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.807255 432 fs_report.cc:352] FS layout report 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/wal 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/wal 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/data/data 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:23.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.842099 432 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:23.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.847935 432 rpc_server.cc:211] RPC server started. Bound to: 127.0.90.61:38857 08:29:23.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.848742 432 webserver.cc:382] Webserver started at http://127.0.90.61:46731/ using document root and password file 08:29:23.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.849303 432 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-1/data/info.pb 08:29:23.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.850553 360 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 432 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.851125 360 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/wal 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/data 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.60:38303 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.60 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/logs 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/data/info.pb 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:23.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:23.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:23.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:23.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:23.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:23.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:23.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.852978 496 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:23.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.856673 496 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } has no permanent_uuid. Determining permanent_uuid... 08:29:23.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.866920 496 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } has no permanent_uuid. Determining permanent_uuid... 08:29:23.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.873208 496 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } has no permanent_uuid. Determining permanent_uuid... 08:29:23.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.874097 496 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.90.60:38303: Network error: Client connection negotiation failed: client connection to 127.0.90.60:38303: connect: Connection refused (error 111) 08:29:23.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.893363 496 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } attempt: 1 08:29:23.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.894585 496 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.90.60:38303: Network error: Client connection negotiation failed: client connection to 127.0.90.60:38303: connect: Connection refused (error 111) 08:29:23.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.910522 431 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } attempt: 3 08:29:23.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.914687 431 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } has no permanent_uuid. Determining permanent_uuid... 08:29:23.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.915401 431 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.90.60:38303: Network error: Client connection negotiation failed: client connection to 127.0.90.60:38303: connect: Connection refused (error 111) 08:29:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.921147 497 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.921414 497 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:23.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.922492 497 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:23.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.922526 497 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:23.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.922538 497 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:23.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.922551 497 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:23.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.924599 497 master_main.cc:98] Master server non-default flags: 08:29:23.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:23.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/data 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/wal 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.60:38303 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/data/info.pb 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.60 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.497 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/logs 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:23.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:23.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:23.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.932550 497 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:23.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.933791 497 hybrid_clock.cc:181] HybridClock initialized: now 1573720163933735 us; error 60 us; skew 500 ppm 08:29:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.934352 497 fs_manager.cc:261] Metadata directory not provided 08:29:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.934403 497 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.934653 497 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.934682 497 server_base.cc:453] Attempting to create new FS layout instead 08:29:23.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.936703 497 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/data/instance: 08:29:23.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "cf43aeeec62649c38bab14d8cc5035a8" 08:29:23.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.937026 497 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/wal/instance: 08:29:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "cf43aeeec62649c38bab14d8cc5035a8" 08:29:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.942271 497 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s 08:29:23.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.942759 496 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } attempt: 2 08:29:23.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.942878 497 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:23.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.943383 497 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:23.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.943833 496 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.90.60:38303: Network error: Client connection negotiation failed: client connection to 127.0.90.60:38303: connect: Connection refused (error 111) 08:29:23.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.946624 497 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:23.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.946714 497 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/wal 08:29:23.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "cf43aeeec62649c38bab14d8cc5035a8" 08:29:23.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:23 on dist-test-slave-dist-test-slave-05kx" 08:29:23.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.946794 497 fs_report.cc:352] FS layout report 08:29:23.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:23.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/wal 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/wal 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/data/data 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:23.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.979583 431 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } attempt: 1 08:29:23.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:23.980506 431 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.90.60:38303: Network error: Client connection negotiation failed: client connection to 127.0.90.60:38303: connect: Connection refused (error 111) 08:29:23.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.985932 497 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:23.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.992151 497 rpc_server.cc:211] RPC server started. Bound to: 127.0.90.60:38303 08:29:23.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.993083 497 webserver.cc:382] Webserver started at http://127.0.90.60:36317/ using document root and password file 08:29:23.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.993742 497 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/master-2/data/info.pb 08:29:23.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.996114 560 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:23.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:23.999447 560 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } has no permanent_uuid. Determining permanent_uuid... 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.000970 360 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 497 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.001570 360 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/wal 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/data 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.1:0 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.90.1 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.1 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/logs 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/data/info.pb 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:24.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.008388 560 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } has no permanent_uuid. Determining permanent_uuid... 08:29:24.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.012424 560 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } has no permanent_uuid. Determining permanent_uuid... 08:29:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.019621 560 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8: Bootstrap starting. 08:29:24.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.021695 560 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8: No blocks or log segments found. Creating new log. 08:29:24.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.022533 560 log.cc:558] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8: Log is configured to *not* fsync() on all Append() calls 08:29:24.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.023835 560 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8: No bootstrap required, opened a new log 08:29:24.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.026357 560 raft_consensus.cc:333] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.026435 560 raft_consensus.cc:359] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:24.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.026468 560 raft_consensus.cc:698] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf43aeeec62649c38bab14d8cc5035a8, State: Initialized, Role: FOLLOWER 08:29:24.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.026885 560 consensus_queue.cc:228] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.027177 560 sys_catalog.cc:340] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.027209 560 sys_catalog.cc:343] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.027933 560 sys_catalog.cc:428] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: configured and running, proceeding with master startup. 08:29:24.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.029227 565 sys_catalog.cc:340] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.029275 565 sys_catalog.cc:343] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.031667 566 catalog_manager.cc:1159] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:24.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.031703 566 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:24.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:24.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.053648 562 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:24.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.053859 562 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:24.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.054829 562 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:24.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.054915 562 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.90.1 08:29:24.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.055049 496 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } attempt: 3 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.056934 562 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/data 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/wal 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.1:0 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:24.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/data/info.pb 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.1 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.562 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.90.1 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/logs 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:24.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:24.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:24.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:24.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:24.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:24.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:24.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.059733 431 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } attempt: 2 08:29:24.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.062472 496 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1: Bootstrap starting. 08:29:24.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.064851 496 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1: No blocks or log segments found. Creating new log. 08:29:24.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.065809 496 log.cc:558] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1: Log is configured to *not* fsync() on all Append() calls 08:29:24.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.066813 562 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:24.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.069530 431 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae: Bootstrap starting. 08:29:24.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.069902 496 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1: No bootstrap required, opened a new log 08:29:24.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.072032 431 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae: No blocks or log segments found. Creating new log. 08:29:24.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.072214 496 raft_consensus.cc:333] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.072289 496 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:24.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.072329 496 raft_consensus.cc:698] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae71b235dcf474da21dbb774a96a4a1, State: Initialized, Role: FOLLOWER 08:29:24.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.072835 496 consensus_queue.cc:228] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.073118 431 log.cc:558] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae: Log is configured to *not* fsync() on all Append() calls 08:29:24.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.073158 496 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.073187 496 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.073539 575 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.073596 575 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.074008 496 sys_catalog.cc:428] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: configured and running, proceeding with master startup. 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.074239 562 hybrid_clock.cc:181] HybridClock initialized: now 1573720164074156 us; error 68 us; skew 500 ppm 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.074676 431 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae: No bootstrap required, opened a new log 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.074774 562 fs_manager.cc:261] Metadata directory not provided 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.074811 562 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.074988 562 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.075004 562 server_base.cc:453] Attempting to create new FS layout instead 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.076661 562 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/data/instance: 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "274ec23017964abeadebcde4222d34ec" 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.077983 431 raft_consensus.cc:333] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.078059 431 raft_consensus.cc:359] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.078112 431 raft_consensus.cc:698] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a2e286ec0641bd9f6c42f325e1f5ae, State: Initialized, Role: FOLLOWER 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.078660 431 consensus_queue.cc:228] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.078954 577 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.078977 577 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:24.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.079030 431 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.079058 431 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.079983 431 sys_catalog.cc:428] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: configured and running, proceeding with master startup. 08:29:24.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.080431 562 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/wal/instance: 08:29:24.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "274ec23017964abeadebcde4222d34ec" 08:29:24.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.080515 579 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.080533 579 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.083351 580 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:24.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.083382 580 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:24.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.090934 562 fs_manager.cc:508] Time spent creating directory manager: real 0.010s user 0.005s sys 0.000s 08:29:24.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.092020 562 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:24.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.092664 562 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:24.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.093480 452 tablet.cc:1764] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.096936 562 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.097100 562 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/wal 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "274ec23017964abeadebcde4222d34ec" 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.097235 562 fs_report.cc:352] FS layout report 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/wal 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/wal 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/data/data 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:24.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:24.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.139309 562 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:24.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.141292 562 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:24.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.141466 562 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:24.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.153371 562 rpc_server.cc:211] RPC server started. Bound to: 127.0.90.1:37709 08:29:24.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.154745 562 webserver.cc:382] Webserver started at http://127.0.90.1:34381/ using document root and password file 08:29:24.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.155527 562 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-0/data/info.pb 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.157580 360 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 562 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.158155 360 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/wal 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/data 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.2:0 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.90.2 08:29:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.2 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/logs 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/data/info.pb 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:24.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:24.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:24.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:24.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:24.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:24.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:24.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.194264 700 heartbeater.cc:322] Connected to a master server at 127.0.90.61:38857 08:29:24.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.194859 700 heartbeater.cc:406] Registering TS with master... 08:29:24.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.195542 700 heartbeater.cc:455] Master 127.0.90.61:38857 requested a full tablet report, sending... 08:29:24.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.197324 463 ts_manager.cc:191] Registered new tserver with Master: 274ec23017964abeadebcde4222d34ec (127.0.90.1:37709) 08:29:24.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.200502 701 heartbeater.cc:322] Connected to a master server at 127.0.90.62:32977 08:29:24.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.200552 701 heartbeater.cc:406] Registering TS with master... 08:29:24.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.200706 701 heartbeater.cc:455] Master 127.0.90.62:32977 requested a full tablet report, sending... 08:29:24.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.202134 397 ts_manager.cc:191] Registered new tserver with Master: 274ec23017964abeadebcde4222d34ec (127.0.90.1:37709) 08:29:24.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.202495 387 tablet.cc:1764] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:24.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.205606 699 heartbeater.cc:322] Connected to a master server at 127.0.90.60:38303 08:29:24.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.205657 699 heartbeater.cc:406] Registering TS with master... 08:29:24.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.205812 699 heartbeater.cc:455] Master 127.0.90.60:38303 requested a full tablet report, sending... 08:29:24.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.206856 527 ts_manager.cc:191] Registered new tserver with Master: 274ec23017964abeadebcde4222d34ec (127.0.90.1:37709) 08:29:24.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.237222 516 tablet.cc:1764] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:24.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:24.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.243579 698 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:24.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.243867 698 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:24.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.245110 698 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:24.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.245200 698 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.90.2 08:29:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.247418 698 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/data 08:29:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/wal 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.2:0 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/data/info.pb 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.2 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.698 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.90.2 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/logs 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:24.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.257423 698 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:24.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.272995 698 hybrid_clock.cc:181] HybridClock initialized: now 1573720164272942 us; error 48 us; skew 500 ppm 08:29:24.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.273779 698 fs_manager.cc:261] Metadata directory not provided 08:29:24.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.273844 698 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:24.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.274134 698 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:24.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.274173 698 server_base.cc:453] Attempting to create new FS layout instead 08:29:24.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.276633 698 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/data/instance: 08:29:24.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" 08:29:24.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.277025 698 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/wal/instance: 08:29:24.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" 08:29:24.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.283607 698 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s 08:29:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.284448 698 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:24.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.285009 698 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:24.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.288877 698 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.289008 698 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/wal 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.289120 698 fs_report.cc:352] FS layout report 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/wal 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/wal 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/data/data 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:24.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:24.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.313293 565 raft_consensus.cc:465] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:24.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.313624 565 raft_consensus.cc:487] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.314909 565 leader_election.cc:296] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08a2e286ec0641bd9f6c42f325e1f5ae (127.0.90.62:32977), 8ae71b235dcf474da21dbb774a96a4a1 (127.0.90.61:38857) 08:29:24.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.315894 407 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf43aeeec62649c38bab14d8cc5035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" is_pre_election: true 08:29:24.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.315899 473 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf43aeeec62649c38bab14d8cc5035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae71b235dcf474da21dbb774a96a4a1" is_pre_election: true 08:29:24.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.316146 473 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf43aeeec62649c38bab14d8cc5035a8 in term 0. 08:29:24.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.316146 407 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf43aeeec62649c38bab14d8cc5035a8 in term 0. 08:29:24.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.316722 508 leader_election.cc:310] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a2e286ec0641bd9f6c42f325e1f5ae, cf43aeeec62649c38bab14d8cc5035a8; no voters: 08:29:24.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.317310 565 raft_consensus.cc:2649] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:24.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.317370 565 raft_consensus.cc:465] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:24.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.317420 565 raft_consensus.cc:2901] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 0 FOLLOWER]: Advancing to term 1 08:29:24.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.318616 565 raft_consensus.cc:487] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.318972 565 leader_election.cc:296] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 08a2e286ec0641bd9f6c42f325e1f5ae (127.0.90.62:32977), 8ae71b235dcf474da21dbb774a96a4a1 (127.0.90.61:38857) 08:29:24.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.319432 407 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf43aeeec62649c38bab14d8cc5035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" 08:29:24.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.319505 407 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [term 0 FOLLOWER]: Advancing to term 1 08:29:24.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.319705 473 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf43aeeec62649c38bab14d8cc5035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae71b235dcf474da21dbb774a96a4a1" 08:29:24.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.319775 473 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [term 0 FOLLOWER]: Advancing to term 1 08:29:24.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.320713 407 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf43aeeec62649c38bab14d8cc5035a8 in term 1. 08:29:24.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.320931 473 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf43aeeec62649c38bab14d8cc5035a8 in term 1. 08:29:24.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.321141 508 leader_election.cc:310] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a2e286ec0641bd9f6c42f325e1f5ae, cf43aeeec62649c38bab14d8cc5035a8; no voters: 08:29:24.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.321321 565 raft_consensus.cc:2649] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 1 FOLLOWER]: Leader election won for term 1 08:29:24.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.321590 565 raft_consensus.cc:660] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [term 1 LEADER]: Becoming Leader. State: Replica: cf43aeeec62649c38bab14d8cc5035a8, State: Running, Role: LEADER 08:29:24.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.322060 565 consensus_queue.cc:205] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } 08:29:24.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.323827 565 sys_catalog.cc:340] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf43aeeec62649c38bab14d8cc5035a8. Latest consensus state: current_term: 1 leader_uuid: "cf43aeeec62649c38bab14d8cc5035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.323874 565 sys_catalog.cc:343] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: This master's current role is: LEADER 08:29:24.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.326578 719 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:24.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.327733 719 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:24.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.393095 698 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:24.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.394520 698 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:24.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.394560 698 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:24.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.398989 473 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [term 1 FOLLOWER]: Refusing update from remote peer cf43aeeec62649c38bab14d8cc5035a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:24.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.400059 407 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [term 1 FOLLOWER]: Refusing update from remote peer cf43aeeec62649c38bab14d8cc5035a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:24.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.401260 565 consensus_queue.cc:981] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:24.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.401576 717 consensus_queue.cc:981] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:24.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.403734 698 rpc_server.cc:211] RPC server started. Bound to: 127.0.90.2:46513 08:29:24.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.404430 698 webserver.cc:382] Webserver started at http://127.0.90.2:39693/ using document root and password file 08:29:24.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.404894 698 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-1/data/info.pb 08:29:24.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.408504 575 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf43aeeec62649c38bab14d8cc5035a8. Latest consensus state: current_term: 1 leader_uuid: "cf43aeeec62649c38bab14d8cc5035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.408552 575 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.409163 579 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf43aeeec62649c38bab14d8cc5035a8. Latest consensus state: current_term: 1 leader_uuid: "cf43aeeec62649c38bab14d8cc5035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.409215 579 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.409314 360 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 698 08:29:24.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.409855 360 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/wal 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/data 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.3:0 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.90.3 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.3 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/logs 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/data/info.pb 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:24.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.415302 717 sys_catalog.cc:340] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cf43aeeec62649c38bab14d8cc5035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.415354 717 sys_catalog.cc:343] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: This master's current role is: LEADER 08:29:24.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.415532 575 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cf43aeeec62649c38bab14d8cc5035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.415536 717 sys_catalog.cc:340] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cf43aeeec62649c38bab14d8cc5035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.415560 717 sys_catalog.cc:343] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8 [sys.catalog]: This master's current role is: LEADER 08:29:24.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.415562 575 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8ae71b235dcf474da21dbb774a96a4a1 [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.416399 725 mvcc.cc:203] Tried to move safe_time back from 6445957793366929408 to 6445957793065586688. Current Snapshot: MvccSnapshot[committed={T|T < 6445957793366929408}] 08:29:24.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.417603 579 sys_catalog.cc:340] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cf43aeeec62649c38bab14d8cc5035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a2e286ec0641bd9f6c42f325e1f5ae" member_type: VOTER last_known_addr { host: "127.0.90.62" port: 32977 } } peers { permanent_uuid: "8ae71b235dcf474da21dbb774a96a4a1" member_type: VOTER last_known_addr { host: "127.0.90.61" port: 38857 } } peers { permanent_uuid: "cf43aeeec62649c38bab14d8cc5035a8" member_type: VOTER last_known_addr { host: "127.0.90.60" port: 38303 } } } 08:29:24.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.417646 579 sys_catalog.cc:343] T 00000000000000000000000000000000 P 08a2e286ec0641bd9f6c42f325e1f5ae [sys.catalog]: This master's current role is: FOLLOWER 08:29:24.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.418658 719 catalog_manager.cc:985] Generated new certificate authority record 08:29:24.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.419803 719 catalog_manager.cc:1110] Loading token signing keys... 08:29:24.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.429594 836 heartbeater.cc:322] Connected to a master server at 127.0.90.62:32977 08:29:24.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.429716 836 heartbeater.cc:406] Registering TS with master... 08:29:24.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.430133 836 heartbeater.cc:455] Master 127.0.90.62:32977 requested a full tablet report, sending... 08:29:24.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.431557 397 ts_manager.cc:191] Registered new tserver with Master: fcbfb2ad89ce4839b2a2b0e46af10a35 (127.0.90.2:46513) 08:29:24.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.432092 834 heartbeater.cc:322] Connected to a master server at 127.0.90.60:38303 08:29:24.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.432178 834 heartbeater.cc:406] Registering TS with master... 08:29:24.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.432415 834 heartbeater.cc:455] Master 127.0.90.60:38303 requested a full tablet report, sending... 08:29:24.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.432824 835 heartbeater.cc:322] Connected to a master server at 127.0.90.61:38857 08:29:24.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.432866 835 heartbeater.cc:406] Registering TS with master... 08:29:24.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.433001 835 heartbeater.cc:455] Master 127.0.90.61:38857 requested a full tablet report, sending... 08:29:24.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.433146 527 ts_manager.cc:191] Registered new tserver with Master: fcbfb2ad89ce4839b2a2b0e46af10a35 (127.0.90.2:46513) 08:29:24.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.433674 463 ts_manager.cc:191] Registered new tserver with Master: fcbfb2ad89ce4839b2a2b0e46af10a35 (127.0.90.2:46513) 08:29:24.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.447230 719 catalog_manager.cc:4455] T 00000000000000000000000000000000 P cf43aeeec62649c38bab14d8cc5035a8: Generated new TSK 0 08:29:24.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.448052 719 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:24.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:24.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.464354 842 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:24.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.464567 842 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:24.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.465670 842 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:24.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.465762 842 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.90.3 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.467344 842 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.90.20:41977 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/data 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/wal 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.90.3:0 08:29:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/data/info.pb 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.90.3 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.90.62:32977,127.0.90.61:38857,127.0.90.60:38303 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.842 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.90.3 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/logs 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:24.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:24.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.474318 842 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:24.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.475492 842 hybrid_clock.cc:181] HybridClock initialized: now 1573720164475461 us; error 30 us; skew 500 ppm 08:29:24.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.475944 842 fs_manager.cc:261] Metadata directory not provided 08:29:24.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.475986 842 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:24.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.476163 842 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:24.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.476188 842 server_base.cc:453] Attempting to create new FS layout instead 08:29:24.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.477856 842 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/data/instance: 08:29:24.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "345e92a10b984273a9a67737353ad9f5" 08:29:24.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.478091 842 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/wal/instance: 08:29:24.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "345e92a10b984273a9a67737353ad9f5" 08:29:24.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.482350 842 fs_manager.cc:508] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s 08:29:24.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.482929 842 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:24.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.483301 842 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.486070 842 fs_manager.cc:424] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.486160 842 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/wal 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "345e92a10b984273a9a67737353ad9f5" 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:24 on dist-test-slave-dist-test-slave-05kx" 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.486228 842 fs_report.cc:352] FS layout report 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/wal 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/wal 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/data/data 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:24.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.518792 842 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:24.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.519776 842 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:24.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.519806 842 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:24.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.527716 842 rpc_server.cc:211] RPC server started. Bound to: 127.0.90.3:34885 08:29:24.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.528455 842 webserver.cc:382] Webserver started at http://127.0.90.3:36753/ using document root and password file 08:29:24.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.528991 842 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster1376382960958164064/ts-2/data/info.pb 08:29:24.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.535624 360 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 842 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.538592 973 heartbeater.cc:322] Connected to a master server at 127.0.90.61:38857 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.538699 974 heartbeater.cc:322] Connected to a master server at 127.0.90.62:32977 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.538779 974 heartbeater.cc:406] Registering TS with master... 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.538776 973 heartbeater.cc:406] Registering TS with master... 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.539104 972 heartbeater.cc:322] Connected to a master server at 127.0.90.60:38303 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.539149 972 heartbeater.cc:406] Registering TS with master... 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.539364 972 heartbeater.cc:455] Master 127.0.90.60:38303 requested a full tablet report, sending... 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.539466 974 heartbeater.cc:455] Master 127.0.90.62:32977 requested a full tablet report, sending... 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.540470 527 ts_manager.cc:191] Registered new tserver with Master: 345e92a10b984273a9a67737353ad9f5 (127.0.90.3:34885) 08:29:24.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.540540 397 ts_manager.cc:191] Registered new tserver with Master: 345e92a10b984273a9a67737353ad9f5 (127.0.90.3:34885) 08:29:24.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.542063 527 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.0.90.3:59027 08:29:24.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.539364 973 heartbeater.cc:455] Master 127.0.90.61:38857 requested a full tablet report, sending... 08:29:24.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.543324 463 ts_manager.cc:191] Registered new tserver with Master: 345e92a10b984273a9a67737353ad9f5 (127.0.90.3:34885) 08:29:24.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.555186 360 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:24.555 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:24.555 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:24.556 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.0.90.62" port: 32977 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.0.90.61" port: 38857 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.0.90.60" port: 38303 } } } 08:29:24.556 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:24.556 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.0.90.1" port: 37709 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.0.90.2" port: 46513 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.0.90.3" port: 34885 } } } 08:29:24.557 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:24.562 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:24.566 [DEBUG - New I/O worker #73] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.0.90.62 08:29:24.567 [DEBUG - New I/O worker #75] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.0.90.61 08:29:24.574 [DEBUG - New I/O worker #74] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.0.90.60 08:29:24.575 [DEBUG - New I/O worker #73] (Negotiator.java:764) Authenticated connection [id: 0x3fa9c5a5, /127.0.0.1:60328 => /127.0.90.62:32977] using SASL/PLAIN 08:29:24.577 [DEBUG - New I/O worker #75] (Negotiator.java:764) Authenticated connection [id: 0xf7930307, /127.0.0.1:33704 => /127.0.90.61:38857] using SASL/PLAIN 08:29:24.581 [DEBUG - New I/O worker #74] (Negotiator.java:764) Authenticated connection [id: 0x61644a29, /127.0.0.1:49216 => /127.0.90.60:38303] using SASL/PLAIN 08:29:24.584 [DEBUG - New I/O worker #74] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:24.585 [DEBUG - New I/O worker #74] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=22), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.90.62:32977, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.90.60:38303, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.90.61:38857, [16ms] Sub RPC ConnectToMaster: received response from server master-127.0.90.62:32977: OK, [17ms] Sub RPC ConnectToMaster: received response from server master-127.0.90.61:38857: OK, [20ms] Sub RPC ConnectToMaster: received response from server master-127.0.90.60:38303: OK, deferred=null) after lookup 08:29:24.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.588433 527 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49216: 08:29:24.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:24.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:24.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:24.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:24.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.589996 527 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:24.600 [DEBUG - New I/O worker #74] (AsyncKuduClient.java:777) Opened table f2fd5e0c008d49dc85751a6ec541f0af 08:29:24.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.609212 630 tablet_service.cc:1023] Processing CreateTablet for tablet 419357e5be5646ef852ac7fa0a060213 (table=org.apache.kudu.client.TestAsyncKuduSession [id=f2fd5e0c008d49dc85751a6ec541f0af]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:24.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.609714 630 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 419357e5be5646ef852ac7fa0a060213. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:24.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.610877 762 tablet_service.cc:1023] Processing CreateTablet for tablet 419357e5be5646ef852ac7fa0a060213 (table=org.apache.kudu.client.TestAsyncKuduSession [id=f2fd5e0c008d49dc85751a6ec541f0af]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:24.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.610877 908 tablet_service.cc:1023] Processing CreateTablet for tablet 419357e5be5646ef852ac7fa0a060213 (table=org.apache.kudu.client.TestAsyncKuduSession [id=f2fd5e0c008d49dc85751a6ec541f0af]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:24.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.611425 908 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 419357e5be5646ef852ac7fa0a060213. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:24.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.611425 762 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 419357e5be5646ef852ac7fa0a060213. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:24.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.614655 996 tablet_bootstrap.cc:439] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec: Bootstrap starting. 08:29:24.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.616039 996 tablet_bootstrap.cc:590] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec: No blocks or log segments found. Creating new log. 08:29:24.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.616690 996 log.cc:558] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec: Log is configured to *not* fsync() on all Append() calls 08:29:24.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.617177 997 tablet_bootstrap.cc:439] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35: Bootstrap starting. 08:29:24.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.618362 997 tablet_bootstrap.cc:590] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35: No blocks or log segments found. Creating new log. 08:29:24.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.618876 997 log.cc:558] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35: Log is configured to *not* fsync() on all Append() calls 08:29:24.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.619463 998 tablet_bootstrap.cc:439] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5: Bootstrap starting. 08:29:24.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.620609 998 tablet_bootstrap.cc:590] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5: No blocks or log segments found. Creating new log. 08:29:24.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.621731 998 log.cc:558] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5: Log is configured to *not* fsync() on all Append() calls 08:29:24.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.622143 996 tablet_bootstrap.cc:439] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec: No bootstrap required, opened a new log 08:29:24.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.622341 996 ts_tablet_manager.cc:1096] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s 08:29:24.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.623222 998 tablet_bootstrap.cc:439] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5: No bootstrap required, opened a new log 08:29:24.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.623220 997 tablet_bootstrap.cc:439] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35: No bootstrap required, opened a new log 08:29:24.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.623385 997 ts_tablet_manager.cc:1096] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s 08:29:24.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.623652 998 ts_tablet_manager.cc:1096] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s 08:29:24.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.625566 996 raft_consensus.cc:333] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.625665 996 raft_consensus.cc:359] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:24.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.625710 996 raft_consensus.cc:698] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 274ec23017964abeadebcde4222d34ec, State: Initialized, Role: FOLLOWER 08:29:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.626350 996 consensus_queue.cc:228] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.626422 997 raft_consensus.cc:333] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.626422 998 raft_consensus.cc:333] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.626495 998 raft_consensus.cc:359] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.626495 997 raft_consensus.cc:359] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.626533 997 raft_consensus.cc:698] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcbfb2ad89ce4839b2a2b0e46af10a35, State: Initialized, Role: FOLLOWER 08:29:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.626544 998 raft_consensus.cc:698] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 345e92a10b984273a9a67737353ad9f5, State: Initialized, Role: FOLLOWER 08:29:24.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.626988 998 consensus_queue.cc:228] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.627117 997 consensus_queue.cc:228] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.627485 972 heartbeater.cc:447] Master 127.0.90.60:38303 was elected leader, sending a full tablet report... 08:29:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.630050 996 ts_tablet_manager.cc:1124] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s 08:29:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.630790 998 ts_tablet_manager.cc:1124] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s 08:29:24.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.631456 527 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.0.90.1:54305 08:29:24.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.633399 699 heartbeater.cc:447] Master 127.0.90.60:38303 was elected leader, sending a full tablet report... 08:29:24.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.634707 526 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.0.90.2:44103 08:29:24.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.635340 997 ts_tablet_manager.cc:1124] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s 08:29:24.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.636279 834 heartbeater.cc:447] Master 127.0.90.60:38303 was elected leader, sending a full tablet report... 08:29:24.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.663353 837 tablet.cc:1764] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.684123 702 tablet.cc:1764] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:24.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.769520 1003 raft_consensus.cc:465] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:24.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.769692 1003 raft_consensus.cc:487] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.770658 1003 leader_election.cc:296] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcbfb2ad89ce4839b2a2b0e46af10a35 (127.0.90.2:46513), 274ec23017964abeadebcde4222d34ec (127.0.90.1:37709) 08:29:24.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.775995 644 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "419357e5be5646ef852ac7fa0a060213" candidate_uuid: "345e92a10b984273a9a67737353ad9f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274ec23017964abeadebcde4222d34ec" is_pre_election: true 08:29:24.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.775995 786 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "419357e5be5646ef852ac7fa0a060213" candidate_uuid: "345e92a10b984273a9a67737353ad9f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" is_pre_election: true 08:29:24.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.776190 786 raft_consensus.cc:2355] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 345e92a10b984273a9a67737353ad9f5 in term 0. 08:29:24.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.776196 644 raft_consensus.cc:2355] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 345e92a10b984273a9a67737353ad9f5 in term 0. 08:29:24.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.776728 858 leader_election.cc:310] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 274ec23017964abeadebcde4222d34ec, 345e92a10b984273a9a67737353ad9f5, fcbfb2ad89ce4839b2a2b0e46af10a35; no voters: 08:29:24.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.777117 1003 raft_consensus.cc:2649] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:24.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.777189 1003 raft_consensus.cc:465] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:24.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.777218 1003 raft_consensus.cc:2901] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 0 FOLLOWER]: Advancing to term 1 08:29:24.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.778338 1003 raft_consensus.cc:487] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.778755 1003 leader_election.cc:296] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [CANDIDATE]: Term 1 election: Requested vote from peers fcbfb2ad89ce4839b2a2b0e46af10a35 (127.0.90.2:46513), 274ec23017964abeadebcde4222d34ec (127.0.90.1:37709) 08:29:24.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.779145 786 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "419357e5be5646ef852ac7fa0a060213" candidate_uuid: "345e92a10b984273a9a67737353ad9f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" 08:29:24.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.779187 644 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "419357e5be5646ef852ac7fa0a060213" candidate_uuid: "345e92a10b984273a9a67737353ad9f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274ec23017964abeadebcde4222d34ec" 08:29:24.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.779212 786 raft_consensus.cc:2901] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35 [term 0 FOLLOWER]: Advancing to term 1 08:29:24.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.779263 644 raft_consensus.cc:2901] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec [term 0 FOLLOWER]: Advancing to term 1 08:29:24.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.780087 786 raft_consensus.cc:2355] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 345e92a10b984273a9a67737353ad9f5 in term 1. 08:29:24.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.780174 644 raft_consensus.cc:2355] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 345e92a10b984273a9a67737353ad9f5 in term 1. 08:29:24.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:24.780464 975 tablet.cc:1764] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:24.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.780565 861 leader_election.cc:310] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 345e92a10b984273a9a67737353ad9f5, fcbfb2ad89ce4839b2a2b0e46af10a35; no voters: 08:29:24.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.780822 1003 raft_consensus.cc:2649] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 1 FOLLOWER]: Leader election won for term 1 08:29:24.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.781008 1003 raft_consensus.cc:660] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [term 1 LEADER]: Becoming Leader. State: Replica: 345e92a10b984273a9a67737353ad9f5, State: Running, Role: LEADER 08:29:24.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.781286 1003 consensus_queue.cc:205] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } } 08:29:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.785135 526 catalog_manager.cc:4143] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 reported cstate change: term changed from 0 to 1, leader changed from to 345e92a10b984273a9a67737353ad9f5 (127.0.90.3). New cstate: current_term: 1 leader_uuid: "345e92a10b984273a9a67737353ad9f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "345e92a10b984273a9a67737353ad9f5" member_type: VOTER last_known_addr { host: "127.0.90.3" port: 34885 } health_report { overall_health: HEALTHY } } } 08:29:24.872 [DEBUG - New I/O worker #74] (AsyncKuduClient.java:2346) Learned about tablet 419357e5be5646ef852ac7fa0a060213 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:24.872 [DEBUG - New I/O worker #74] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=419357e5be5646ef852ac7fa0a060213@[274ec23017964abeadebcde4222d34ec(127.0.90.1:37709),345e92a10b984273a9a67737353ad9f5(127.0.90.3:34885)[L],fcbfb2ad89ce4839b2a2b0e46af10a35(127.0.90.2:46513)]}] 08:29:24.883 [DEBUG - Hashed wheel timer #9] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@13882bd7, flushNotification=Deferred@491771862(state=PENDING, result=null, callback=, errback=)} 08:29:24.892 [DEBUG - New I/O worker #76] (Negotiator.java:764) Authenticated connection [id: 0xacbad353, /127.0.0.1:51672 => /127.0.90.3:34885] using TOKEN/null 08:29:24.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.899771 644 raft_consensus.cc:1177] T 419357e5be5646ef852ac7fa0a060213 P 274ec23017964abeadebcde4222d34ec [term 1 FOLLOWER]: Refusing update from remote peer 345e92a10b984273a9a67737353ad9f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:24.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.899785 786 raft_consensus.cc:1177] T 419357e5be5646ef852ac7fa0a060213 P fcbfb2ad89ce4839b2a2b0e46af10a35 [term 1 FOLLOWER]: Refusing update from remote peer 345e92a10b984273a9a67737353ad9f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:24.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.900669 1003 consensus_queue.cc:981] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcbfb2ad89ce4839b2a2b0e46af10a35" member_type: VOTER last_known_addr { host: "127.0.90.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:24.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.900876 1005 consensus_queue.cc:981] T 419357e5be5646ef852ac7fa0a060213 P 345e92a10b984273a9a67737353ad9f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "274ec23017964abeadebcde4222d34ec" member_type: VOTER last_known_addr { host: "127.0.90.1" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:24.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.908897 1008 mvcc.cc:203] Tried to move safe_time back from 6445957795421052928 to 6445957794946244608. Current Snapshot: MvccSnapshot[committed={T|T < 6445957795421052928}] 08:29:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.912945 1009 mvcc.cc:203] Tried to move safe_time back from 6445957795421052928 to 6445957794946244608. Current Snapshot: MvccSnapshot[committed={T|T < 6445957795421052928}] 08:29:24.917 [DEBUG - New I/O worker #75] (Connection.java:691) [peer master-127.0.90.61:38857(127.0.90.61:38857)] cleaning up while in state READY due to: connection disconnected 08:29:24.918 [DEBUG - New I/O worker #76] (Connection.java:691) [peer 345e92a10b984273a9a67737353ad9f5(127.0.90.3:34885)] cleaning up while in state READY due to: connection disconnected 08:29:24.919 [DEBUG - New I/O worker #74] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:24.919 [DEBUG - New I/O worker #73] (Connection.java:691) [peer master-127.0.90.62:32977(127.0.90.62:32977)] cleaning up while in state READY due to: connection disconnected 08:29:24.920 [DEBUG - New I/O worker #74] (Connection.java:691) [peer master-127.0.90.60:38303(127.0.90.60:38303)] cleaning up while in state READY due to: connection disconnected 08:29:24.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.920581 360 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 562 08:29:24.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.926374 360 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 698 08:29:24.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.930755 360 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 842 08:29:24.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.934384 360 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 369 08:29:24.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.938676 360 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 432 08:29:24.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:24.942289 360 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 497 08:29:24.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:24Z chronyd exiting 08:29:24.967 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720164967 08:29:24.970 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:24.971 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:24.971 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:24.971 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:24.971 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:24.973 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569" hms_mode: NONE mini_kdc_options { } } 08:29:25.048 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:25.049 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:25.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:25.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:25Z Disabled control of system clock 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.066749 1020 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/wal 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/data 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.62:42305 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.62 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/logs 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/data/info.pb 08:29:25.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:25.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:25.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.125923 1029 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:25.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.126149 1029 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:25.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.127224 1029 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:25.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.127259 1029 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:25.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.127272 1029 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:25.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.127285 1029 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.129212 1029 master_main.cc:98] Master server non-default flags: 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/data 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/wal 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.62:42305 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/data/info.pb 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.62 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.1029 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/logs 08:29:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.136921 1029 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:25.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.138099 1029 hybrid_clock.cc:181] HybridClock initialized: now 1573720165138074 us; error 28 us; skew 500 ppm 08:29:25.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.138624 1029 fs_manager.cc:261] Metadata directory not provided 08:29:25.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.138705 1029 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:25.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.138986 1029 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:25.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.139017 1029 server_base.cc:453] Attempting to create new FS layout instead 08:29:25.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.140964 1029 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/data/instance: 08:29:25.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "eae9b39269d34158ae11ea212a11e9ff" 08:29:25.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.141280 1029 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/wal/instance: 08:29:25.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "eae9b39269d34158ae11ea212a11e9ff" 08:29:25.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.146659 1029 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s 08:29:25.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.147625 1029 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:25.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.148178 1029 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.151624 1029 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.151747 1029 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/wal 08:29:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "eae9b39269d34158ae11ea212a11e9ff" 08:29:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.151840 1029 fs_report.cc:352] FS layout report 08:29:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/wal 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/wal 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/data/data 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:25.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.192739 1029 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.198839 1029 rpc_server.cc:211] RPC server started. Bound to: 127.0.255.62:42305 08:29:25.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.199771 1029 webserver.cc:382] Webserver started at http://127.0.255.62:44875/ using document root and password file 08:29:25.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.200371 1029 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-0/data/info.pb 08:29:25.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.202468 1020 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 1029 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.203011 1020 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/wal 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/data 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.61:36385 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.61 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/logs 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/data/info.pb 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:25.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.203743 1091 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:25.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.207547 1091 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.216645 1091 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.217419 1091 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.255.61:36385: Network error: Client connection negotiation failed: client connection to 127.0.255.61:36385: connect: Connection refused (error 111) 08:29:25.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.236843 1091 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } attempt: 1 08:29:25.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.237995 1091 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.255.61:36385: Network error: Client connection negotiation failed: client connection to 127.0.255.61:36385: connect: Connection refused (error 111) 08:29:25.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:25.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.264346 1092 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:25.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.264575 1092 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:25.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.265555 1092 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:25.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.265583 1092 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:25.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.265591 1092 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:25.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.265599 1092 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.267511 1092 master_main.cc:98] Master server non-default flags: 08:29:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/data 08:29:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/wal 08:29:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.61:36385 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/data/info.pb 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.61 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.1092 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/logs 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:25.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:25.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.275547 1092 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:25.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.276768 1092 hybrid_clock.cc:181] HybridClock initialized: now 1573720165276717 us; error 53 us; skew 500 ppm 08:29:25.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.277400 1092 fs_manager.cc:261] Metadata directory not provided 08:29:25.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.277468 1092 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:25.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.277726 1092 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:25.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.277755 1092 server_base.cc:453] Attempting to create new FS layout instead 08:29:25.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.279814 1092 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/data/instance: 08:29:25.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "389e312686a144ffabf14fb441dd73f7" 08:29:25.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.280072 1092 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/wal/instance: 08:29:25.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "389e312686a144ffabf14fb441dd73f7" 08:29:25.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.285535 1092 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s 08:29:25.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.286167 1091 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } attempt: 2 08:29:25.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.286201 1092 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:25.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.286689 1092 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:25.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.287214 1091 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.255.61:36385: Network error: Client connection negotiation failed: client connection to 127.0.255.61:36385: connect: Connection refused (error 111) 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.290057 1092 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.290153 1092 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/wal 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "389e312686a144ffabf14fb441dd73f7" 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.290235 1092 fs_report.cc:352] FS layout report 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/wal 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/wal 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/data/data 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:25.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:25.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.315699 1092 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:25.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.321480 1092 rpc_server.cc:211] RPC server started. Bound to: 127.0.255.61:36385 08:29:25.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.322347 1092 webserver.cc:382] Webserver started at http://127.0.255.61:44885/ using document root and password file 08:29:25.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.322912 1092 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-1/data/info.pb 08:29:25.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.325541 1155 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.328189 1020 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 1092 08:29:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.328678 1020 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/wal 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/data 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.60:39529 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.60 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/logs 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/data/info.pb 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.329406 1155 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.339022 1155 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.345759 1155 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.346673 1155 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.255.60:39529: Network error: Client connection negotiation failed: client connection to 127.0.255.60:39529: connect: Connection refused (error 111) 08:29:25.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.365975 1155 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } attempt: 1 08:29:25.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.367184 1155 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.255.60:39529: Network error: Client connection negotiation failed: client connection to 127.0.255.60:39529: connect: Connection refused (error 111) 08:29:25.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:25.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.396721 1156 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:25.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.396980 1156 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:25.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.397930 1156 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:25.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.397958 1156 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:25.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.397965 1156 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:25.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.397974 1156 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:25.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.398383 1091 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } attempt: 3 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.399941 1156 master_main.cc:98] Master server non-default flags: 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/data 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/wal 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.60:39529 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/data/info.pb 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.60 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.1156 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/logs 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:25.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.403225 1091 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.403985 1091 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.255.60:39529: Network error: Client connection negotiation failed: client connection to 127.0.255.60:39529: connect: Connection refused (error 111) 08:29:25.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.408464 1156 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:25.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.409644 1156 hybrid_clock.cc:181] HybridClock initialized: now 1573720165409581 us; error 61 us; skew 500 ppm 08:29:25.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.410212 1156 fs_manager.cc:261] Metadata directory not provided 08:29:25.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.410265 1156 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:25.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.410506 1156 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:25.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.410539 1156 server_base.cc:453] Attempting to create new FS layout instead 08:29:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.412569 1156 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/data/instance: 08:29:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "085e26ab772e467e8922fbe510d28bea" 08:29:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.412889 1156 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/wal/instance: 08:29:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "085e26ab772e467e8922fbe510d28bea" 08:29:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.415385 1155 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } attempt: 2 08:29:25.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.416379 1155 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.255.60:39529: Network error: Client connection negotiation failed: client connection to 127.0.255.60:39529: connect: Connection refused (error 111) 08:29:25.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.418612 1156 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s 08:29:25.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.419242 1156 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:25.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.419654 1156 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:25.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.422859 1156 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:25.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.422950 1156 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/wal 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "085e26ab772e467e8922fbe510d28bea" 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.423030 1156 fs_report.cc:352] FS layout report 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/wal 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/wal 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/data/data 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:25.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.468164 1091 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } attempt: 1 08:29:25.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.469311 1091 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.0.255.60:39529: Network error: Client connection negotiation failed: client connection to 127.0.255.60:39529: connect: Connection refused (error 111) 08:29:25.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.475920 1156 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:25.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.481217 1156 rpc_server.cc:211] RPC server started. Bound to: 127.0.255.60:39529 08:29:25.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.482062 1156 webserver.cc:382] Webserver started at http://127.0.255.60:36071/ using document root and password file 08:29:25.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.482599 1156 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/master-2/data/info.pb 08:29:25.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.485472 1220 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:25.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.485882 1020 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 1156 08:29:25.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.486497 1020 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:25.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:25.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/wal 08:29:25.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/data 08:29:25.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:25.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.1:0 08:29:25.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.255.1 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.1 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/logs 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/data/info.pb 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:25.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.491137 1220 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.499994 1220 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.503763 1220 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } has no permanent_uuid. Determining permanent_uuid... 08:29:25.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.510479 1220 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea: Bootstrap starting. 08:29:25.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.512221 1220 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea: No blocks or log segments found. Creating new log. 08:29:25.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.513041 1220 log.cc:558] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea: Log is configured to *not* fsync() on all Append() calls 08:29:25.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.514217 1220 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea: No bootstrap required, opened a new log 08:29:25.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.516300 1220 raft_consensus.cc:333] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.516371 1220 raft_consensus.cc:359] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:25.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.516398 1220 raft_consensus.cc:698] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 085e26ab772e467e8922fbe510d28bea, State: Initialized, Role: FOLLOWER 08:29:25.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.516772 1220 consensus_queue.cc:228] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.517110 1220 sys_catalog.cc:340] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.517160 1220 sys_catalog.cc:343] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.517848 1220 sys_catalog.cc:428] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: configured and running, proceeding with master startup. 08:29:25.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.518201 1225 sys_catalog.cc:340] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.518574 1225 sys_catalog.cc:343] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.520318 1226 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:25.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.520354 1226 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:25.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.527575 1155 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } attempt: 3 08:29:25.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.535282 1155 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7: Bootstrap starting. 08:29:25.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.537705 1155 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7: No blocks or log segments found. Creating new log. 08:29:25.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.538663 1155 log.cc:558] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7: Log is configured to *not* fsync() on all Append() calls 08:29:25.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.540531 1155 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7: No bootstrap required, opened a new log 08:29:25.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:25.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.542563 1221 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:25.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.542843 1221 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.544059 1221 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.544147 1221 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.255.1 08:29:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.544250 1155 raft_consensus.cc:333] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.544327 1155 raft_consensus.cc:359] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.544420 1155 raft_consensus.cc:698] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389e312686a144ffabf14fb441dd73f7, State: Initialized, Role: FOLLOWER 08:29:25.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.544993 1155 consensus_queue.cc:228] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.545398 1155 sys_catalog.cc:340] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.545447 1155 sys_catalog.cc:343] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.545519 1229 sys_catalog.cc:340] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.545552 1229 sys_catalog.cc:343] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.546393 1221 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/data 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/wal 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.1:0 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/data/info.pb 08:29:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.1 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.1221 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.255.1 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/logs 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:25.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:25.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:25.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:25.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:25.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.546521 1155 sys_catalog.cc:428] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: configured and running, proceeding with master startup. 08:29:25.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.548470 1091 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } attempt: 2 08:29:25.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.552870 1233 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:25.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.552909 1233 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.556720 1221 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.556859 1091 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff: Bootstrap starting. 08:29:25.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.559074 1091 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff: No blocks or log segments found. Creating new log. 08:29:25.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.559996 1091 log.cc:558] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff: Log is configured to *not* fsync() on all Append() calls 08:29:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.561758 1091 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff: No bootstrap required, opened a new log 08:29:25.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.564383 1091 raft_consensus.cc:333] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.564477 1091 raft_consensus.cc:359] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:25.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.564579 1091 raft_consensus.cc:698] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae9b39269d34158ae11ea212a11e9ff, State: Initialized, Role: FOLLOWER 08:29:25.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.564891 1221 hybrid_clock.cc:181] HybridClock initialized: now 1573720165564730 us; error 47 us; skew 500 ppm 08:29:25.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.565146 1091 consensus_queue.cc:228] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.565654 1091 sys_catalog.cc:340] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.565811 1091 sys_catalog.cc:343] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.565827 1221 fs_manager.cc:261] Metadata directory not provided 08:29:25.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.565877 1221 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:25.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.566191 1221 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:25.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.566335 1221 server_base.cc:453] Attempting to create new FS layout instead 08:29:25.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.567054 1111 tablet.cc:1764] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:25.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.567121 1091 sys_catalog.cc:428] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: configured and running, proceeding with master startup. 08:29:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.569123 1238 sys_catalog.cc:340] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.569187 1238 sys_catalog.cc:343] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.569378 1221 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/data/instance: 08:29:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6d3699da958c42a9a66ada25879bf116" 08:29:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.569711 1221 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/wal/instance: 08:29:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6d3699da958c42a9a66ada25879bf116" 08:29:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.572381 1239 catalog_manager.cc:1159] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:25.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.572425 1239 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:25.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.578424 1221 fs_manager.cc:508] Time spent creating directory manager: real 0.008s user 0.005s sys 0.000s 08:29:25.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.579188 1221 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:25.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.579682 1221 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:25.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.582773 1221 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:25.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.582921 1221 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/wal 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6d3699da958c42a9a66ada25879bf116" 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.583066 1221 fs_report.cc:352] FS layout report 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/wal 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/wal 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/data/data 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:25.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:25.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:25.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.619753 1221 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:25.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.621332 1221 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:25.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.621363 1221 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:25.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.630759 1221 rpc_server.cc:211] RPC server started. Bound to: 127.0.255.1:34069 08:29:25.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.632066 1221 webserver.cc:382] Webserver started at http://127.0.255.1:37485/ using document root and password file 08:29:25.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.632848 1221 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-0/data/info.pb 08:29:25.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.633448 1020 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 1221 08:29:25.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.634157 1020 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:25.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:25.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/wal 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/data 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.2:0 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.255.2 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.2 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/logs 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/data/info.pb 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:25.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.649152 1359 heartbeater.cc:322] Connected to a master server at 127.0.255.62:42305 08:29:25.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.649693 1359 heartbeater.cc:406] Registering TS with master... 08:29:25.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.650301 1358 heartbeater.cc:322] Connected to a master server at 127.0.255.60:39529 08:29:25.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.650629 1358 heartbeater.cc:406] Registering TS with master... 08:29:25.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.650828 1358 heartbeater.cc:455] Master 127.0.255.60:39529 requested a full tablet report, sending... 08:29:25.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.650399 1359 heartbeater.cc:455] Master 127.0.255.62:42305 requested a full tablet report, sending... 08:29:25.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.652631 1187 ts_manager.cc:191] Registered new tserver with Master: 6d3699da958c42a9a66ada25879bf116 (127.0.255.1:34069) 08:29:25.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.653010 1055 ts_manager.cc:191] Registered new tserver with Master: 6d3699da958c42a9a66ada25879bf116 (127.0.255.1:34069) 08:29:25.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.654870 1357 heartbeater.cc:322] Connected to a master server at 127.0.255.61:36385 08:29:25.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.654929 1357 heartbeater.cc:406] Registering TS with master... 08:29:25.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.655092 1357 heartbeater.cc:455] Master 127.0.255.61:36385 requested a full tablet report, sending... 08:29:25.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.656090 1119 ts_manager.cc:191] Registered new tserver with Master: 6d3699da958c42a9a66ada25879bf116 (127.0.255.1:34069) 08:29:25.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.694371 1046 tablet.cc:1764] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:25.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.727378 1175 tablet.cc:1764] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:25.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:25.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.738729 1361 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:25.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.738976 1361 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:25.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.739989 1361 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:25.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.740073 1361 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.255.2 08:29:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.743517 1361 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/data 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/wal 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.2:0 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/data/info.pb 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.2 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.1361 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.255.2 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/logs 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:25.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:25.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.751467 1361 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:25.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.752682 1361 hybrid_clock.cc:181] HybridClock initialized: now 1573720165752621 us; error 57 us; skew 500 ppm 08:29:25.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.753275 1361 fs_manager.cc:261] Metadata directory not provided 08:29:25.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.753329 1361 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:25.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.753585 1361 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:25.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.753614 1361 server_base.cc:453] Attempting to create new FS layout instead 08:29:25.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.755388 1361 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/data/instance: 08:29:25.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "efa9be0a2e694840ba40159581571db0" 08:29:25.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.755702 1361 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/wal/instance: 08:29:25.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "efa9be0a2e694840ba40159581571db0" 08:29:25.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.761134 1361 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s 08:29:25.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.762168 1361 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:25.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.762784 1361 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.767117 1361 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.767305 1361 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/wal 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "efa9be0a2e694840ba40159581571db0" 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.767436 1361 fs_report.cc:352] FS layout report 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/wal 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/wal 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/data/data 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:25.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:25.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.829844 1361 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:25.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.831198 1361 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:25.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.831233 1361 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:25.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.840005 1361 rpc_server.cc:211] RPC server started. Bound to: 127.0.255.2:35767 08:29:25.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.841111 1361 webserver.cc:382] Webserver started at http://127.0.255.2:46037/ using document root and password file 08:29:25.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.841773 1361 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-1/data/info.pb 08:29:25.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.848119 1020 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 1361 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.848685 1020 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/wal 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/data 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.3:0 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.255.3 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.3 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/logs 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/data/info.pb 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.852279 1486 heartbeater.cc:322] Connected to a master server at 127.0.255.61:36385 08:29:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.852385 1487 heartbeater.cc:322] Connected to a master server at 127.0.255.60:39529 08:29:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.852450 1487 heartbeater.cc:406] Registering TS with master... 08:29:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.852280 1488 heartbeater.cc:322] Connected to a master server at 127.0.255.62:42305 08:29:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.852490 1488 heartbeater.cc:406] Registering TS with master... 08:29:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.852449 1486 heartbeater.cc:406] Registering TS with master... 08:29:25.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.853031 1487 heartbeater.cc:455] Master 127.0.255.60:39529 requested a full tablet report, sending... 08:29:25.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.853044 1486 heartbeater.cc:455] Master 127.0.255.61:36385 requested a full tablet report, sending... 08:29:25.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.853484 1488 heartbeater.cc:455] Master 127.0.255.62:42305 requested a full tablet report, sending... 08:29:25.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.854171 1187 ts_manager.cc:191] Registered new tserver with Master: efa9be0a2e694840ba40159581571db0 (127.0.255.2:35767) 08:29:25.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.854260 1119 ts_manager.cc:191] Registered new tserver with Master: efa9be0a2e694840ba40159581571db0 (127.0.255.2:35767) 08:29:25.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.854462 1055 ts_manager.cc:191] Registered new tserver with Master: efa9be0a2e694840ba40159581571db0 (127.0.255.2:35767) 08:29:25.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.869385 1229 raft_consensus.cc:465] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:25.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.869619 1229 raft_consensus.cc:487] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.870895 1229 leader_election.cc:296] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae9b39269d34158ae11ea212a11e9ff (127.0.255.62:42305), 085e26ab772e467e8922fbe510d28bea (127.0.255.60:39529) 08:29:25.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.871826 1196 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "389e312686a144ffabf14fb441dd73f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "085e26ab772e467e8922fbe510d28bea" is_pre_election: true 08:29:25.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.871897 1068 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "389e312686a144ffabf14fb441dd73f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae9b39269d34158ae11ea212a11e9ff" is_pre_election: true 08:29:25.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.872066 1196 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389e312686a144ffabf14fb441dd73f7 in term 0. 08:29:25.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.872153 1068 raft_consensus.cc:2355] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389e312686a144ffabf14fb441dd73f7 in term 0. 08:29:25.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.872637 1104 leader_election.cc:310] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 085e26ab772e467e8922fbe510d28bea, 389e312686a144ffabf14fb441dd73f7; no voters: 08:29:25.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.873060 1229 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:25.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.873131 1229 raft_consensus.cc:465] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:25.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.873158 1229 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 0 FOLLOWER]: Advancing to term 1 08:29:25.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.874476 1229 raft_consensus.cc:487] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.874910 1229 leader_election.cc:296] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [CANDIDATE]: Term 1 election: Requested vote from peers eae9b39269d34158ae11ea212a11e9ff (127.0.255.62:42305), 085e26ab772e467e8922fbe510d28bea (127.0.255.60:39529) 08:29:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.875301 1068 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "389e312686a144ffabf14fb441dd73f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae9b39269d34158ae11ea212a11e9ff" 08:29:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.875311 1196 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "389e312686a144ffabf14fb441dd73f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "085e26ab772e467e8922fbe510d28bea" 08:29:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.875371 1196 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [term 0 FOLLOWER]: Advancing to term 1 08:29:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.875396 1068 raft_consensus.cc:2901] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [term 0 FOLLOWER]: Advancing to term 1 08:29:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.876391 1196 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389e312686a144ffabf14fb441dd73f7 in term 1. 08:29:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.876400 1068 raft_consensus.cc:2355] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389e312686a144ffabf14fb441dd73f7 in term 1. 08:29:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.876720 1104 leader_election.cc:310] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389e312686a144ffabf14fb441dd73f7, eae9b39269d34158ae11ea212a11e9ff; no voters: 08:29:25.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.876950 1229 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 1 FOLLOWER]: Leader election won for term 1 08:29:25.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.877187 1229 raft_consensus.cc:660] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [term 1 LEADER]: Becoming Leader. State: Replica: 389e312686a144ffabf14fb441dd73f7, State: Running, Role: LEADER 08:29:25.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.877589 1229 consensus_queue.cc:205] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } 08:29:25.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.879766 1494 sys_catalog.cc:340] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 389e312686a144ffabf14fb441dd73f7. Latest consensus state: current_term: 1 leader_uuid: "389e312686a144ffabf14fb441dd73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.879815 1494 sys_catalog.cc:343] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: This master's current role is: LEADER 08:29:25.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.880447 1496 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:25.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.881765 1496 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.908233 1493 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.908516 1493 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:25.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.909736 1493 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:25.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.909778 1196 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [term 1 FOLLOWER]: Refusing update from remote peer 389e312686a144ffabf14fb441dd73f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:25.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:25.909832 1493 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.255.3 08:29:25.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.910239 1068 raft_consensus.cc:1177] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [term 1 FOLLOWER]: Refusing update from remote peer 389e312686a144ffabf14fb441dd73f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:25.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.910601 1494 consensus_queue.cc:981] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:25.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.911038 1229 consensus_queue.cc:981] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:25.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.911999 1493 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.0.255.20:35489 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/data 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/wal 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.0.255.3:0 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/data/info.pb 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.0.255.3 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.0.255.62:42305,127.0.255.61:36385,127.0.255.60:39529 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.1493 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.0.255.3 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/logs 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:25.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:25.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:25.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:25.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.914877 1225 sys_catalog.cc:340] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 389e312686a144ffabf14fb441dd73f7. Latest consensus state: current_term: 1 leader_uuid: "389e312686a144ffabf14fb441dd73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.914903 1225 sys_catalog.cc:343] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.915606 1238 sys_catalog.cc:340] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 389e312686a144ffabf14fb441dd73f7. Latest consensus state: current_term: 1 leader_uuid: "389e312686a144ffabf14fb441dd73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.915659 1238 sys_catalog.cc:343] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.920805 1497 mvcc.cc:203] Tried to move safe_time back from 6445957799557758976 to 6445957799436701696. Current Snapshot: MvccSnapshot[committed={T|T < 6445957799557758976}] 08:29:25.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.921239 1225 sys_catalog.cc:340] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "389e312686a144ffabf14fb441dd73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.921274 1225 sys_catalog.cc:343] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.922101 1238 sys_catalog.cc:340] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "389e312686a144ffabf14fb441dd73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.922142 1238 sys_catalog.cc:343] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff [sys.catalog]: This master's current role is: FOLLOWER 08:29:25.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.924386 1501 mvcc.cc:203] Tried to move safe_time back from 6445957799557758976 to 6445957799436701696. Current Snapshot: MvccSnapshot[committed={T|T < 6445957799557758976}] 08:29:25.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.924605 1502 mvcc.cc:203] Tried to move safe_time back from 6445957799557758976 to 6445957799436701696. Current Snapshot: MvccSnapshot[committed={T|T < 6445957799557758976 or (T in {6445957799557758976})}] 08:29:25.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.924710 1493 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.925976 1496 catalog_manager.cc:985] Generated new certificate authority record 08:29:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.926244 1494 sys_catalog.cc:340] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "389e312686a144ffabf14fb441dd73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.926283 1494 sys_catalog.cc:343] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: This master's current role is: LEADER 08:29:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.926379 1229 sys_catalog.cc:340] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "389e312686a144ffabf14fb441dd73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae9b39269d34158ae11ea212a11e9ff" member_type: VOTER last_known_addr { host: "127.0.255.62" port: 42305 } } peers { permanent_uuid: "389e312686a144ffabf14fb441dd73f7" member_type: VOTER last_known_addr { host: "127.0.255.61" port: 36385 } } peers { permanent_uuid: "085e26ab772e467e8922fbe510d28bea" member_type: VOTER last_known_addr { host: "127.0.255.60" port: 39529 } } } 08:29:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.926434 1229 sys_catalog.cc:343] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7 [sys.catalog]: This master's current role is: LEADER 08:29:25.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.927348 1496 catalog_manager.cc:1110] Loading token signing keys... 08:29:25.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.928084 1493 hybrid_clock.cc:181] HybridClock initialized: now 1573720165928022 us; error 62 us; skew 500 ppm 08:29:25.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.928617 1493 fs_manager.cc:261] Metadata directory not provided 08:29:25.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.928666 1493 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:25.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.928978 1493 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:25.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.929025 1493 server_base.cc:453] Attempting to create new FS layout instead 08:29:25.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.930769 1493 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/data/instance: 08:29:25.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6cf2d1df989f45498a34070d299edc82" 08:29:25.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.931011 1493 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/wal/instance: 08:29:25.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6cf2d1df989f45498a34070d299edc82" 08:29:25.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.936156 1493 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s 08:29:25.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.936956 1493 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:25.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.937392 1493 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:25.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.938632 1496 catalog_manager.cc:4455] T 00000000000000000000000000000000 P 389e312686a144ffabf14fb441dd73f7: Generated new TSK 0 08:29:25.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.939309 1496 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.941514 1493 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.941612 1493 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/wal 08:29:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "6cf2d1df989f45498a34070d299edc82" 08:29:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:25 on dist-test-slave-dist-test-slave-05kx" 08:29:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.941684 1493 fs_report.cc:352] FS layout report 08:29:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/wal 08:29:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/wal 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/data/data 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:25.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.954017 1493 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:25.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.955075 1493 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:25.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.955106 1493 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:25.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.962469 1493 rpc_server.cc:211] RPC server started. Bound to: 127.0.255.3:41985 08:29:25.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.963122 1493 webserver.cc:382] Webserver started at http://127.0.255.3:42089/ using document root and password file 08:29:25.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.963517 1493 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster962156176177005569/ts-2/data/info.pb 08:29:25.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.966250 1020 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 1493 08:29:25.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.980062 1628 heartbeater.cc:322] Connected to a master server at 127.0.255.61:36385 08:29:25.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.980187 1630 heartbeater.cc:322] Connected to a master server at 127.0.255.62:42305 08:29:25.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.980273 1630 heartbeater.cc:406] Registering TS with master... 08:29:25.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.980841 1629 heartbeater.cc:322] Connected to a master server at 127.0.255.60:39529 08:29:25.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.980911 1629 heartbeater.cc:406] Registering TS with master... 08:29:25.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.981061 1629 heartbeater.cc:455] Master 127.0.255.60:39529 requested a full tablet report, sending... 08:29:25.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.980197 1628 heartbeater.cc:406] Registering TS with master... 08:29:25.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.981578 1628 heartbeater.cc:455] Master 127.0.255.61:36385 requested a full tablet report, sending... 08:29:25.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.981743 1630 heartbeater.cc:455] Master 127.0.255.62:42305 requested a full tablet report, sending... 08:29:25.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.982136 1187 ts_manager.cc:191] Registered new tserver with Master: 6cf2d1df989f45498a34070d299edc82 (127.0.255.3:41985) 08:29:25.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.982197 1119 ts_manager.cc:191] Registered new tserver with Master: 6cf2d1df989f45498a34070d299edc82 (127.0.255.3:41985) 08:29:25.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.983059 1055 ts_manager.cc:191] Registered new tserver with Master: 6cf2d1df989f45498a34070d299edc82 (127.0.255.3:41985) 08:29:25.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.983816 1119 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.0.255.3:58967 08:29:25.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:25.989976 1020 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:25.990 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:25.990 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:25.990 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.0.255.62" port: 42305 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.0.255.61" port: 36385 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.0.255.60" port: 39529 } } } 08:29:25.991 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:25.991 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.0.255.1" port: 34069 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.0.255.2" port: 35767 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.0.255.3" port: 41985 } } } 08:29:25.991 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:25.996 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:26.000 [DEBUG - New I/O worker #83] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.0.255.62 08:29:26.000 [DEBUG - New I/O worker #82] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.0.255.61 08:29:26.000 [DEBUG - New I/O worker #84] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.0.255.60 08:29:26.008 [DEBUG - New I/O worker #83] (Negotiator.java:764) Authenticated connection [id: 0xf9900897, /127.0.0.1:47886 => /127.0.255.62:42305] using SASL/PLAIN 08:29:26.008 [DEBUG - New I/O worker #84] (Negotiator.java:764) Authenticated connection [id: 0xd5a105b3, /127.0.0.1:56798 => /127.0.255.60:39529] using SASL/PLAIN 08:29:26.013 [DEBUG - New I/O worker #82] (Negotiator.java:764) Authenticated connection [id: 0xd2e14cde, /127.0.0.1:42728 => /127.0.255.61:36385] using SASL/PLAIN 08:29:26.022 [DEBUG - New I/O worker #82] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:26.022 [DEBUG - New I/O worker #82] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=26), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.255.61:36385, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.255.62:42305, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.255.60:39529, [16ms] Sub RPC ConnectToMaster: received response from server master-127.0.255.60:39529: OK, [18ms] Sub RPC ConnectToMaster: received response from server master-127.0.255.62:42305: OK, [25ms] Sub RPC ConnectToMaster: received response from server master-127.0.255.61:36385: OK, deferred=null) after lookup 08:29:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.026579 1119 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42728: 08:29:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:26.027824 1119 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:26.037 [DEBUG - New I/O worker #82] (AsyncKuduClient.java:777) Opened table 9f7c18514be74c058eda4a3454e415bf 08:29:26.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.047905 1564 tablet_service.cc:1023] Processing CreateTablet for tablet 2d0c8687504d4f5f81ddd69b072b1d91 (table=org.apache.kudu.client.TestAsyncKuduSession [id=9f7c18514be74c058eda4a3454e415bf]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:26.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.048053 1422 tablet_service.cc:1023] Processing CreateTablet for tablet 2d0c8687504d4f5f81ddd69b072b1d91 (table=org.apache.kudu.client.TestAsyncKuduSession [id=9f7c18514be74c058eda4a3454e415bf]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:26.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.048061 1293 tablet_service.cc:1023] Processing CreateTablet for tablet 2d0c8687504d4f5f81ddd69b072b1d91 (table=org.apache.kudu.client.TestAsyncKuduSession [id=9f7c18514be74c058eda4a3454e415bf]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:26.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.048461 1564 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 2d0c8687504d4f5f81ddd69b072b1d91. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:26.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.048591 1293 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 2d0c8687504d4f5f81ddd69b072b1d91. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:26.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.048591 1422 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 2d0c8687504d4f5f81ddd69b072b1d91. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:26.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.055147 1653 tablet_bootstrap.cc:439] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82: Bootstrap starting. 08:29:26.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.057078 1655 tablet_bootstrap.cc:439] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116: Bootstrap starting. 08:29:26.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.058403 1655 tablet_bootstrap.cc:590] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116: No blocks or log segments found. Creating new log. 08:29:26.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.059312 1655 log.cc:558] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116: Log is configured to *not* fsync() on all Append() calls 08:29:26.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.059937 1654 tablet_bootstrap.cc:439] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0: Bootstrap starting. 08:29:26.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.061391 1654 tablet_bootstrap.cc:590] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0: No blocks or log segments found. Creating new log. 08:29:26.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.061931 1654 log.cc:558] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0: Log is configured to *not* fsync() on all Append() calls 08:29:26.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.062408 1653 tablet_bootstrap.cc:590] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82: No blocks or log segments found. Creating new log. 08:29:26.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.063045 1653 log.cc:558] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82: Log is configured to *not* fsync() on all Append() calls 08:29:26.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.064894 1654 tablet_bootstrap.cc:439] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0: No bootstrap required, opened a new log 08:29:26.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.065024 1655 tablet_bootstrap.cc:439] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116: No bootstrap required, opened a new log 08:29:26.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.065145 1654 ts_tablet_manager.cc:1096] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s 08:29:26.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.065191 1655 ts_tablet_manager.cc:1096] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s 08:29:26.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.065392 1653 tablet_bootstrap.cc:439] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82: No bootstrap required, opened a new log 08:29:26.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.065564 1653 ts_tablet_manager.cc:1096] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s 08:29:26.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.067724 1655 raft_consensus.cc:333] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.067948 1655 raft_consensus.cc:359] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:26.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.068104 1655 raft_consensus.cc:698] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d3699da958c42a9a66ada25879bf116, State: Initialized, Role: FOLLOWER 08:29:26.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.068364 1654 raft_consensus.cc:333] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.068365 1653 raft_consensus.cc:333] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.068480 1653 raft_consensus.cc:359] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:26.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.068518 1653 raft_consensus.cc:698] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf2d1df989f45498a34070d299edc82, State: Initialized, Role: FOLLOWER 08:29:26.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.068732 1655 consensus_queue.cc:228] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.069002 1653 consensus_queue.cc:228] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.069013 1654 raft_consensus.cc:359] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.069051 1654 raft_consensus.cc:698] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efa9be0a2e694840ba40159581571db0, State: Initialized, Role: FOLLOWER 08:29:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.069490 1654 consensus_queue.cc:228] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.069967 1628 heartbeater.cc:447] Master 127.0.255.61:36385 was elected leader, sending a full tablet report... 08:29:26.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.072675 1119 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.0.255.1:40545 08:29:26.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.073678 1118 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.0.255.2:53115 08:29:26.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.074431 1653 ts_tablet_manager.cc:1124] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82: Time spent starting tablet: real 0.009s user 0.002s sys 0.002s 08:29:26.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.075389 1654 ts_tablet_manager.cc:1124] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s 08:29:26.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.077030 1486 heartbeater.cc:447] Master 127.0.255.61:36385 was elected leader, sending a full tablet report... 08:29:26.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.078737 1655 ts_tablet_manager.cc:1124] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s 08:29:26.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:26.093466 1489 tablet.cc:1764] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:26.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:26.139801 1360 tablet.cc:1764] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:26.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:26.215420 1631 tablet.cc:1764] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:26.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.345886 1659 raft_consensus.cc:465] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:26.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.346098 1659 raft_consensus.cc:487] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.347096 1659 leader_election.cc:296] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efa9be0a2e694840ba40159581571db0 (127.0.255.2:35767), 6cf2d1df989f45498a34070d299edc82 (127.0.255.3:41985) 08:29:26.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.352630 1584 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "2d0c8687504d4f5f81ddd69b072b1d91" candidate_uuid: "6d3699da958c42a9a66ada25879bf116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf2d1df989f45498a34070d299edc82" is_pre_election: true 08:29:26.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.352879 1584 raft_consensus.cc:2355] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d3699da958c42a9a66ada25879bf116 in term 0. 08:29:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.353130 1442 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "2d0c8687504d4f5f81ddd69b072b1d91" candidate_uuid: "6d3699da958c42a9a66ada25879bf116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efa9be0a2e694840ba40159581571db0" is_pre_election: true 08:29:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.353310 1442 raft_consensus.cc:2355] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d3699da958c42a9a66ada25879bf116 in term 0. 08:29:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.353489 1244 leader_election.cc:310] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf2d1df989f45498a34070d299edc82, 6d3699da958c42a9a66ada25879bf116; no voters: 08:29:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.353816 1659 raft_consensus.cc:2649] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.353870 1659 raft_consensus.cc:465] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:26.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.353897 1659 raft_consensus.cc:2901] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 0 FOLLOWER]: Advancing to term 1 08:29:26.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.354840 1659 raft_consensus.cc:487] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.355175 1659 leader_election.cc:296] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [CANDIDATE]: Term 1 election: Requested vote from peers efa9be0a2e694840ba40159581571db0 (127.0.255.2:35767), 6cf2d1df989f45498a34070d299edc82 (127.0.255.3:41985) 08:29:26.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.355512 1442 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "2d0c8687504d4f5f81ddd69b072b1d91" candidate_uuid: "6d3699da958c42a9a66ada25879bf116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efa9be0a2e694840ba40159581571db0" 08:29:26.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.355571 1584 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "2d0c8687504d4f5f81ddd69b072b1d91" candidate_uuid: "6d3699da958c42a9a66ada25879bf116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf2d1df989f45498a34070d299edc82" 08:29:26.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.355576 1442 raft_consensus.cc:2901] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0 [term 0 FOLLOWER]: Advancing to term 1 08:29:26.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.355633 1584 raft_consensus.cc:2901] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82 [term 0 FOLLOWER]: Advancing to term 1 08:29:26.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.356367 1584 raft_consensus.cc:2355] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d3699da958c42a9a66ada25879bf116 in term 1. 08:29:26.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.356628 1442 raft_consensus.cc:2355] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d3699da958c42a9a66ada25879bf116 in term 1. 08:29:26.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.356703 1244 leader_election.cc:310] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf2d1df989f45498a34070d299edc82, 6d3699da958c42a9a66ada25879bf116; no voters: 08:29:26.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.356918 1659 raft_consensus.cc:2649] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 1 FOLLOWER]: Leader election won for term 1 08:29:26.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.357079 1659 raft_consensus.cc:660] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [term 1 LEADER]: Becoming Leader. State: Replica: 6d3699da958c42a9a66ada25879bf116, State: Running, Role: LEADER 08:29:26.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.357342 1357 heartbeater.cc:447] Master 127.0.255.61:36385 was elected leader, sending a full tablet report... 08:29:26.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.357365 1659 consensus_queue.cc:205] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } } 08:29:26.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.360674 1119 catalog_manager.cc:4143] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 reported cstate change: term changed from 0 to 1, leader changed from to 6d3699da958c42a9a66ada25879bf116 (127.0.255.1). New cstate: current_term: 1 leader_uuid: "6d3699da958c42a9a66ada25879bf116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d3699da958c42a9a66ada25879bf116" member_type: VOTER last_known_addr { host: "127.0.255.1" port: 34069 } health_report { overall_health: HEALTHY } } } 08:29:26.381 [DEBUG - New I/O worker #82] (AsyncKuduClient.java:2346) Learned about tablet 2d0c8687504d4f5f81ddd69b072b1d91 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:26.381 [DEBUG - New I/O worker #82] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=2d0c8687504d4f5f81ddd69b072b1d91@[6cf2d1df989f45498a34070d299edc82(127.0.255.3:41985),6d3699da958c42a9a66ada25879bf116(127.0.255.1:34069)[L],efa9be0a2e694840ba40159581571db0(127.0.255.2:35767)]}] 08:29:26.497 [DEBUG - Hashed wheel timer #10] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@71120655, flushNotification=Deferred@2144724487(state=PENDING, result=null, callback=, errback=)} 08:29:26.506 [DEBUG - New I/O worker #85] (Negotiator.java:764) Authenticated connection [id: 0x353e5219, /127.0.0.1:51248 => /127.0.255.1:34069] using TOKEN/null 08:29:26.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.513656 1584 raft_consensus.cc:1177] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6cf2d1df989f45498a34070d299edc82 [term 1 FOLLOWER]: Refusing update from remote peer 6d3699da958c42a9a66ada25879bf116: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:26.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.513866 1442 raft_consensus.cc:1177] T 2d0c8687504d4f5f81ddd69b072b1d91 P efa9be0a2e694840ba40159581571db0 [term 1 FOLLOWER]: Refusing update from remote peer 6d3699da958c42a9a66ada25879bf116: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:26.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.514478 1664 consensus_queue.cc:981] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf2d1df989f45498a34070d299edc82" member_type: VOTER last_known_addr { host: "127.0.255.3" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:26.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.514644 1659 consensus_queue.cc:981] T 2d0c8687504d4f5f81ddd69b072b1d91 P 6d3699da958c42a9a66ada25879bf116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efa9be0a2e694840ba40159581571db0" member_type: VOTER last_known_addr { host: "127.0.255.2" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:26.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.524600 1226 catalog_manager.cc:1157] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea: acquiring CA information for follower catalog manager: success 08:29:26.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.527114 1226 catalog_manager.cc:1185] T 00000000000000000000000000000000 P 085e26ab772e467e8922fbe510d28bea: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:26.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.527281 1669 mvcc.cc:203] Tried to move safe_time back from 6445957802032340992 to 6445957801401585664. Current Snapshot: MvccSnapshot[committed={T|T < 6445957802032340992}] 08:29:26.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.527580 1667 mvcc.cc:203] Tried to move safe_time back from 6445957802032340992 to 6445957801401585664. Current Snapshot: MvccSnapshot[committed={T|T < 6445957802032340992}] 08:29:26.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.576377 1239 catalog_manager.cc:1157] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff: acquiring CA information for follower catalog manager: success 08:29:26.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.577978 1239 catalog_manager.cc:1185] T 00000000000000000000000000000000 P eae9b39269d34158ae11ea212a11e9ff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 08:29:26.617 [DEBUG - Hashed wheel timer #10] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3ee8ec3c, flushNotification=Deferred@1604936986(state=PENDING, result=null, callback=, errback=)} 08:29:26.941 [DEBUG - New I/O worker #85] (Connection.java:691) [peer 6d3699da958c42a9a66ada25879bf116(127.0.255.1:34069)] cleaning up while in state READY due to: connection disconnected 08:29:26.941 [DEBUG - New I/O worker #84] (Connection.java:691) [peer master-127.0.255.60:39529(127.0.255.60:39529)] cleaning up while in state READY due to: connection disconnected 08:29:26.943 [DEBUG - New I/O worker #82] (Connection.java:691) [peer master-127.0.255.61:36385(127.0.255.61:36385)] cleaning up while in state READY due to: connection disconnected 08:29:26.943 [DEBUG - New I/O worker #83] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:26.943 [DEBUG - New I/O worker #83] (Connection.java:691) [peer master-127.0.255.62:42305(127.0.255.62:42305)] cleaning up while in state READY due to: connection disconnected 08:29:26.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.944108 1020 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 1221 08:29:26.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.950959 1020 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 1361 08:29:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.956471 1020 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 1493 08:29:26.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.960150 1020 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 1029 08:29:26.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.964396 1020 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 1092 08:29:26.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:26.968056 1020 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 1156 08:29:26.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:26Z chronyd exiting 08:29:26.994 [INFO - main] (RandomUtils.java:47) Using random seed: 1573720166994 08:29:26.998 [INFO - main] (RetryRule.java:136) Creating RetryStatement with result reporter and retry count of 0 (no retries) .08:29:26.998 [INFO - main] (KuduTestHarness.java:139) Creating a new MiniKuduCluster... 08:29:26.998 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHFigEJ/test-tmp 08:29:26.999 [INFO - main] (KuduBinaryLocator.java:78) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin 08:29:26.999 [INFO - main] (MiniKuduCluster.java:187) Starting process: [/tmp/dist-test-taskHFigEJ/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb] 08:29:27.001 [DEBUG - main] (MiniKuduCluster.java:155) Request: create_cluster { num_masters: 3 num_tservers: 3 enable_kerberos: false cluster_root: "/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477" hms_mode: NONE mini_kdc_options { } } 08:29:27.071 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:27.072 [DEBUG - main] (MiniKuduCluster.java:155) Request: start_cluster { } 08:29:27.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG) 08:29:27.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:27Z Disabled control of system clock 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.088310 1678 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/wal 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/data 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.190:35563 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.190 08:29:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/logs 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/data/info.pb 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:27.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:27.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.141608 1687 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:27.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.141836 1687 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:27.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.142920 1687 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:27.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.142952 1687 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:27.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.142966 1687 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:27.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.142978 1687 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.144963 1687 master_main.cc:98] Master server non-default flags: 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/data 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/wal 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.190:35563 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/data/info.pb 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.190 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.1687 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/logs 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:27.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:27.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:27.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:27.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:27.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.152307 1687 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:27.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.153486 1687 hybrid_clock.cc:181] HybridClock initialized: now 1573720167153432 us; error 68 us; skew 500 ppm 08:29:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.153992 1687 fs_manager.cc:261] Metadata directory not provided 08:29:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.154043 1687 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.154321 1687 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.154351 1687 server_base.cc:453] Attempting to create new FS layout instead 08:29:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.156154 1687 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/data/instance: 08:29:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8e364b2371ed4d5ca79e7899587eff58" 08:29:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.156456 1687 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/wal/instance: 08:29:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8e364b2371ed4d5ca79e7899587eff58" 08:29:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.161713 1687 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s 08:29:27.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.162691 1687 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:27.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.163218 1687 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:27.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.166600 1687 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:27.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.166720 1687 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/wal 08:29:27.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "8e364b2371ed4d5ca79e7899587eff58" 08:29:27.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.166818 1687 fs_report.cc:352] FS layout report 08:29:27.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:27.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/wal 08:29:27.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/wal 08:29:27.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/data/data 08:29:27.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:27.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:27.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.189250 1687 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:27.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.196544 1687 rpc_server.cc:211] RPC server started. Bound to: 127.1.163.190:35563 08:29:27.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.197471 1687 webserver.cc:382] Webserver started at http://127.1.163.190:44669/ using document root and password file 08:29:27.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.198012 1687 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-0/data/info.pb 08:29:27.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.201112 1749 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:27.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.203487 1678 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 1687 08:29:27.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.203881 1678 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/wal 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/data 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.189:46147 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.189 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/logs 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/data/info.pb 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:27.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.209543 1749 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.220870 1749 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.221632 1749 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.1.163.189:46147: Network error: Client connection negotiation failed: client connection to 127.1.163.189:46147: connect: Connection refused (error 111) 08:29:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.240900 1749 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } attempt: 1 08:29:27.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.241961 1749 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.1.163.189:46147: Network error: Client connection negotiation failed: client connection to 127.1.163.189:46147: connect: Connection refused (error 111) 08:29:27.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:27.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.269856 1750 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:27.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.270105 1750 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:27.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.271185 1750 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:27.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.271219 1750 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:27.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.271232 1750 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:27.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.271246 1750 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.273265 1750 master_main.cc:98] Master server non-default flags: 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/data 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/wal 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.189:46147 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/data/info.pb 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.189 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.1750 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/logs 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:27.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.281668 1750 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:27.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.282869 1750 hybrid_clock.cc:181] HybridClock initialized: now 1573720167282827 us; error 42 us; skew 500 ppm 08:29:27.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.283497 1750 fs_manager.cc:261] Metadata directory not provided 08:29:27.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.283562 1750 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:27.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.283864 1750 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:27.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.283895 1750 server_base.cc:453] Attempting to create new FS layout instead 08:29:27.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.286070 1750 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/data/instance: 08:29:27.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" 08:29:27.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.286381 1750 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/wal/instance: 08:29:27.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" 08:29:27.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.290143 1749 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } attempt: 2 08:29:27.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.291085 1749 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.1.163.189:46147: Network error: Client connection negotiation failed: client connection to 127.1.163.189:46147: connect: Connection refused (error 111) 08:29:27.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.292309 1750 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s 08:29:27.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.293051 1750 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:27.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.293524 1750 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:27.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.296770 1750 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.296931 1750 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/wal 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.297092 1750 fs_report.cc:352] FS layout report 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/wal 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/wal 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/data/data 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.317533 1750 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.322953 1750 rpc_server.cc:211] RPC server started. Bound to: 127.1.163.189:46147 08:29:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.323866 1750 webserver.cc:382] Webserver started at http://127.1.163.189:34095/ using document root and password file 08:29:27.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.324479 1750 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-1/data/info.pb 08:29:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.327760 1813 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:27.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.328685 1678 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 1750 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.329104 1678 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/wal 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/data 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=localhost 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.188:42515 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.188 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/logs 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/data/info.pb 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.332177 1813 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.344708 1813 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.350127 1813 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.350916 1813 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.1.163.188:42515: Network error: Client connection negotiation failed: client connection to 127.1.163.188:42515: connect: Connection refused (error 111) 08:29:27.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.370175 1813 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } attempt: 1 08:29:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.371206 1813 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.1.163.188:42515: Network error: Client connection negotiation failed: client connection to 127.1.163.188:42515: connect: Connection refused (error 111) 08:29:27.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:27.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.396733 1814 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:27.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.397063 1814 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:27.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.398211 1814 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 08:29:27.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.398243 1814 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:27.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.398257 1814 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 08:29:27.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.398268 1814 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.400303 1814 master_main.cc:98] Master server non-default flags: 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/data 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/wal 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_ca_key_size=1024 08:29:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --master_addresses=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tsk_num_rsa_bits=512 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.188:42515 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_reuseport=true 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/data/info.pb 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.188 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-master.1814 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/logs 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Master server version: 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:27.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.402287 1749 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } attempt: 3 08:29:27.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.406878 1749 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.407657 1749 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.1.163.188:42515: Network error: Client connection negotiation failed: client connection to 127.1.163.188:42515: connect: Connection refused (error 111) 08:29:27.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.409839 1814 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:27.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.411042 1814 hybrid_clock.cc:181] HybridClock initialized: now 1573720167410991 us; error 40 us; skew 500 ppm 08:29:27.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.411697 1814 fs_manager.cc:261] Metadata directory not provided 08:29:27.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.411753 1814 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:27.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.412099 1814 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:27.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.412133 1814 server_base.cc:453] Attempting to create new FS layout instead 08:29:27.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.414345 1814 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/data/instance: 08:29:27.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "42fedda836824b128b95272dcade365a" 08:29:27.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.414661 1814 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/wal/instance: 08:29:27.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "42fedda836824b128b95272dcade365a" 08:29:27.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.419401 1813 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } attempt: 2 08:29:27.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.420342 1813 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.1.163.188:42515: Network error: Client connection negotiation failed: client connection to 127.1.163.188:42515: connect: Connection refused (error 111) 08:29:27.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.420490 1814 fs_manager.cc:508] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s 08:29:27.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.421226 1814 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:27.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.421669 1814 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.424979 1814 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.425076 1814 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/wal 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "42fedda836824b128b95272dcade365a" 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.425158 1814 fs_report.cc:352] FS layout report 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/wal 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/wal 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/data/data 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:27.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:27.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.471854 1749 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } attempt: 1 08:29:27.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.473053 1749 consensus_peers.cc:623] Error getting permanent uuid from config peer 127.1.163.188:42515: Network error: Client connection negotiation failed: client connection to 127.1.163.188:42515: connect: Connection refused (error 111) 08:29:27.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.483983 1814 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:27.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.489893 1814 rpc_server.cc:211] RPC server started. Bound to: 127.1.163.188:42515 08:29:27.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.490803 1814 webserver.cc:382] Webserver started at http://127.1.163.188:35871/ using document root and password file 08:29:27.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.491324 1814 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/master-2/data/info.pb 08:29:27.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.493819 1878 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:27.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.496953 1878 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.497247 1678 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master as pid 1814 08:29:27.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.497932 1678 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/wal 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/data 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.129:0 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.1.163.129 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.129 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/logs 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/data/info.pb 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:27.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.505334 1878 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.509479 1878 sys_catalog.cc:307] member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } has no permanent_uuid. Determining permanent_uuid... 08:29:27.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.517372 1878 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a: Bootstrap starting. 08:29:27.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.519419 1878 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a: No blocks or log segments found. Creating new log. 08:29:27.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.520560 1878 log.cc:558] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a: Log is configured to *not* fsync() on all Append() calls 08:29:27.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.522145 1878 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a: No bootstrap required, opened a new log 08:29:27.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.524570 1878 raft_consensus.cc:333] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.524658 1878 raft_consensus.cc:359] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:27.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.524696 1878 raft_consensus.cc:698] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42fedda836824b128b95272dcade365a, State: Initialized, Role: FOLLOWER 08:29:27.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.525182 1878 consensus_queue.cc:228] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.525480 1878 sys_catalog.cc:340] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.525516 1878 sys_catalog.cc:343] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.525622 1883 sys_catalog.cc:340] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.525661 1883 sys_catalog.cc:343] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.526376 1878 sys_catalog.cc:428] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: configured and running, proceeding with master startup. 08:29:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.531553 1813 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } attempt: 3 08:29:27.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.533663 1884 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:27.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.533723 1884 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:27.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.537945 1813 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc: Bootstrap starting. 08:29:27.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.539996 1813 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc: No blocks or log segments found. Creating new log. 08:29:27.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.540900 1813 log.cc:558] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc: Log is configured to *not* fsync() on all Append() calls 08:29:27.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.546111 1813 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc: No bootstrap required, opened a new log 08:29:27.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.548843 1813 raft_consensus.cc:333] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.548933 1813 raft_consensus.cc:359] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:27.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.548987 1813 raft_consensus.cc:698] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb9a72e6d5544a18bed7c8da3be22ccc, State: Initialized, Role: FOLLOWER 08:29:27.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.549523 1813 consensus_queue.cc:228] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.549916 1813 sys_catalog.cc:340] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.549996 1813 sys_catalog.cc:343] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.550863 1813 sys_catalog.cc:428] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: configured and running, proceeding with master startup. 08:29:27.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.552260 1749 consensus_peers.cc:633] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } attempt: 2 08:29:27.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.553104 1887 sys_catalog.cc:340] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.556318 1887 sys_catalog.cc:343] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:27.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.556571 1880 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:27.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.556843 1880 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:27.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.558054 1880 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:27.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.558147 1880 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.163.129 08:29:27.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.558722 1749 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58: Bootstrap starting. 08:29:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.560369 1880 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/data 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/wal 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.129:0 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/data/info.pb 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.129 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.1880 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.1.163.129 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/logs 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.556275 1888 catalog_manager.cc:1159] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.560832 1888 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.560931 1749 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58: No blocks or log segments found. Creating new log. 08:29:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.562045 1749 log.cc:558] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58: Log is configured to *not* fsync() on all Append() calls 08:29:27.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.563876 1749 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58: No bootstrap required, opened a new log 08:29:27.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.566540 1749 raft_consensus.cc:333] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.566633 1749 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:27.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.566691 1749 raft_consensus.cc:698] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e364b2371ed4d5ca79e7899587eff58, State: Initialized, Role: FOLLOWER 08:29:27.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.567220 1749 consensus_queue.cc:228] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.567596 1749 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.567634 1749 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.567803 1894 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.567867 1894 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.568534 1749 sys_catalog.cc:428] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: configured and running, proceeding with master startup. 08:29:27.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.570292 1880 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:27.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.571259 1769 tablet.cc:1764] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:27.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.571359 1895 catalog_manager.cc:1159] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58: acquiring CA information for follower catalog manager: Not found: root CA entry not found 08:29:27.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.571388 1895 catalog_manager.cc:631] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry 08:29:27.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.578039 1880 hybrid_clock.cc:181] HybridClock initialized: now 1573720167577985 us; error 47 us; skew 500 ppm 08:29:27.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.578730 1880 fs_manager.cc:261] Metadata directory not provided 08:29:27.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.578789 1880 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:27.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.579063 1880 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:27.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.579102 1880 server_base.cc:453] Attempting to create new FS layout instead 08:29:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.581545 1880 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/data/instance: 08:29:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" 08:29:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.581883 1880 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/wal/instance: 08:29:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" 08:29:27.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.592444 1880 fs_manager.cc:508] Time spent creating directory manager: real 0.010s user 0.002s sys 0.004s 08:29:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.594103 1880 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.594928 1880 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:27.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.599648 1880 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.600069 1880 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/wal 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.600481 1880 fs_report.cc:352] FS layout report 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/wal 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/wal 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/data/data 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:27.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:27.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.639919 1880 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:27.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.642032 1880 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:27.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.642238 1880 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:27.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.652297 1880 rpc_server.cc:211] RPC server started. Bound to: 127.1.163.129:33255 08:29:27.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.653923 1880 webserver.cc:382] Webserver started at http://127.1.163.129:43329/ using document root and password file 08:29:27.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.654965 1880 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-0/data/info.pb 08:29:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.657634 1903 reactor.cc:666] StartConnect: connect in progress for 127.1.163.188:42515 08:29:27.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.665232 1678 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 1880 08:29:27.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.665943 1678 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:27.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:27.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/wal 08:29:27.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/data 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.130:0 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.1.163.130 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.130 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/logs 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/data/info.pb 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:27.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.676079 2016 heartbeater.cc:322] Connected to a master server at 127.1.163.190:35563 08:29:27.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.676602 2016 heartbeater.cc:406] Registering TS with master... 08:29:27.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.677829 2016 heartbeater.cc:455] Master 127.1.163.190:35563 requested a full tablet report, sending... 08:29:27.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.678201 2014 heartbeater.cc:322] Connected to a master server at 127.1.163.188:42515 08:29:27.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.678561 2014 heartbeater.cc:406] Registering TS with master... 08:29:27.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.678951 2014 heartbeater.cc:455] Master 127.1.163.188:42515 requested a full tablet report, sending... 08:29:27.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.679953 1714 ts_manager.cc:191] Registered new tserver with Master: 3d20d304ce8c46e28c8b8d2b6e70248a (127.1.163.129:33255) 08:29:27.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.680290 1836 ts_manager.cc:191] Registered new tserver with Master: 3d20d304ce8c46e28c8b8d2b6e70248a (127.1.163.129:33255) 08:29:27.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.686990 2015 heartbeater.cc:322] Connected to a master server at 127.1.163.189:46147 08:29:27.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.687350 2015 heartbeater.cc:406] Registering TS with master... 08:29:27.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.687757 2015 heartbeater.cc:455] Master 127.1.163.189:46147 requested a full tablet report, sending... 08:29:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.689487 1780 ts_manager.cc:191] Registered new tserver with Master: 3d20d304ce8c46e28c8b8d2b6e70248a (127.1.163.129:33255) 08:29:27.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.693387 1704 tablet.cc:1764] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:27.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.738354 1833 tablet.cc:1764] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:27.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:27.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.760053 2021 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:27.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.760248 2021 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:27.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.761082 2021 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:27.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.761143 2021 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.163.130 08:29:27.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.762706 2021 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:27.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/data 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/wal 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.130:0 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/data/info.pb 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.130 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.2021 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.1.163.130 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/logs 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:27.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:27.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.769428 2021 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:27.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.770599 2021 hybrid_clock.cc:181] HybridClock initialized: now 1573720167770577 us; error 32 us; skew 500 ppm 08:29:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.771039 2021 fs_manager.cc:261] Metadata directory not provided 08:29:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.771080 2021 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.771266 2021 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.771293 2021 server_base.cc:453] Attempting to create new FS layout instead 08:29:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.772982 2021 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/data/instance: 08:29:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" 08:29:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.773221 2021 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/wal/instance: 08:29:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" 08:29:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.777663 2021 fs_manager.cc:508] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s 08:29:27.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.778228 2021 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:27.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.778569 2021 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.781481 2021 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.781577 2021 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/wal 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.781647 2021 fs_report.cc:352] FS layout report 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/wal 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/wal 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/data/data 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:27.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.828704 2021 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:27.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.830058 2021 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:27.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.830088 2021 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:27.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.837715 2021 rpc_server.cc:211] RPC server started. Bound to: 127.1.163.130:40657 08:29:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.838551 2021 webserver.cc:382] Webserver started at http://127.1.163.130:35523/ using document root and password file 08:29:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.839004 2021 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-1/data/info.pb 08:29:27.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.846791 1678 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 2021 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.847427 1678 external_mini_cluster.cc:1039] Running /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/wal 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/data 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --block_manager=log 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.131:0 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.1.163.131 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.131 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/logs 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/data/info.pb 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin with env {} 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.848307 2143 heartbeater.cc:322] Connected to a master server at 127.1.163.189:46147 08:29:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.848449 2143 heartbeater.cc:406] Registering TS with master... 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.848685 2144 heartbeater.cc:322] Connected to a master server at 127.1.163.190:35563 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.848726 2144 heartbeater.cc:406] Registering TS with master... 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.848311 2142 heartbeater.cc:322] Connected to a master server at 127.1.163.188:42515 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.848855 2142 heartbeater.cc:406] Registering TS with master... 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.848939 2144 heartbeater.cc:455] Master 127.1.163.190:35563 requested a full tablet report, sending... 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.848959 2142 heartbeater.cc:455] Master 127.1.163.188:42515 requested a full tablet report, sending... 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.849874 1836 ts_manager.cc:191] Registered new tserver with Master: 64820f6ca27a4083ba3bbfb5af6b1a5b (127.1.163.130:40657) 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.849874 1714 ts_manager.cc:191] Registered new tserver with Master: 64820f6ca27a4083ba3bbfb5af6b1a5b (127.1.163.130:40657) 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.850288 2143 heartbeater.cc:455] Master 127.1.163.189:46147 requested a full tablet report, sending... 08:29:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.850889 1780 ts_manager.cc:191] Registered new tserver with Master: 64820f6ca27a4083ba3bbfb5af6b1a5b (127.1.163.130:40657) 08:29:27.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) WARNING: Logging before InitGoogleLogging() is written to STDERR 08:29:27.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.900435 2149 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true 08:29:27.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.900694 2149 flags.cc:404] Enabled unsafe flag: --never_fsync=true 08:29:27.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.901700 2149 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 08:29:27.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:27.901782 2149 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.163.131 08:29:27.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.903662 2149 tablet_server_main.cc:78] Tablet server non-default flags: 08:29:27.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_poll_interval_ms=100 08:29:27.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --builtin_ntp_servers=127.1.163.148:33791 08:29:27.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ntp_initial_sync_wait_secs=10 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --time_source=builtin 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_data_dirs=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/data 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --fs_wal_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/wal 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --ipki_server_key_size=1024 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_bind_addresses=127.1.163.131:0 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --rpc_server_allow_ephemeral_ports=true 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --metrics_log_interval_ms=1000 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_format=pb 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --server_dump_info_path=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/data/info.pb 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_interface=127.1.163.131 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --webserver_port=0 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --tserver_master_addrs=127.1.163.190:35563,127.1.163.189:46147,127.1.163.188:42515 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --never_fsync=true 08:29:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --heap_profile_path=/tmp/kudu-tserver.2149 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --redact=none 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_experimental_flags=true 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --unlock_unsafe_flags=true 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --enable_minidumps=false 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --local_ip_for_outbound_sockets=127.1.163.131 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --log_dir=/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/logs 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logbuflevel=-1 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) --logtostderr=true 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Tablet server version: 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) kudu 1.11.0.7.1.0.0-SNAPSHOT 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) revision 5924ac3208c8cd3e3bd291900f78e6e9642a958f 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build type DEBUG 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) built by jenkins at 13 Nov 2019 23:43:51 PST on quasar-qcjfbe-1.vpc.cloudera.com 08:29:27.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) build id 524233 08:29:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.912518 2149 hybrid_clock.cc:163] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize 08:29:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.913708 2149 hybrid_clock.cc:181] HybridClock initialized: now 1573720167913687 us; error 32 us; skew 500 ppm 08:29:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.914297 2149 fs_manager.cc:261] Metadata directory not provided 08:29:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.914350 2149 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory 08:29:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.914642 2149 server_base.cc:452] Could not load existing FS layout: Not found: could not find a healthy instance file 08:29:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.914674 2149 server_base.cc:453] Attempting to create new FS layout instead 08:29:27.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.916673 2149 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/data/instance: 08:29:27.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "302a04508a8c48b8bff5eae9bfed8f70" 08:29:27.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.917050 2149 fs_manager.cc:607] Generated new instance metadata in path /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/wal/instance: 08:29:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "302a04508a8c48b8bff5eae9bfed8f70" 08:29:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.922426 2149 fs_manager.cc:508] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s 08:29:27.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.923243 2149 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go 08:29:27.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.923732 2149 file_cache.cc:465] Constructed file cache lbm with capacity 419430 08:29:27.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.926839 2149 fs_manager.cc:424] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s 08:29:27.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.926951 2149 fs_manager.cc:441] Opened local filesystem: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/data,/tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/wal 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) uuid: "302a04508a8c48b8bff5eae9bfed8f70" 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) format_stamp: "Formatted at 2019-11-14 08:29:27 on dist-test-slave-dist-test-slave-05kx" 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.927028 2149 fs_report.cc:352] FS layout report 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) -------------------- 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) wal directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/wal 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) metadata directory: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/wal 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 1 data directories: /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/data/data 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live blocks: 0 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes: 0 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total live bytes (after alignment): 0 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total number of LBM containers: 0 (0 full) 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for missing blocks 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Did not check for orphaned blocks 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM containers with extra space: 0 (0 repaired) 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total full LBM container extra space in bytes: 0 (0 repaired) 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total incomplete LBM containers: 0 (0 repaired) 08:29:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) Total LBM partial records: 0 (0 repaired) 08:29:27.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.931187 1894 raft_consensus.cc:465] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:27.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.931474 1894 raft_consensus.cc:487] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.932770 1894 leader_election.cc:296] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb9a72e6d5544a18bed7c8da3be22ccc (127.1.163.189:46147), 42fedda836824b128b95272dcade365a (127.1.163.188:42515) 08:29:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.933671 1854 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8e364b2371ed4d5ca79e7899587eff58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42fedda836824b128b95272dcade365a" is_pre_election: true 08:29:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.933909 1854 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e364b2371ed4d5ca79e7899587eff58 in term 0. 08:29:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.934027 1790 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8e364b2371ed4d5ca79e7899587eff58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" is_pre_election: true 08:29:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.934267 1790 raft_consensus.cc:2355] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e364b2371ed4d5ca79e7899587eff58 in term 0. 08:29:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.934432 1697 leader_election.cc:310] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42fedda836824b128b95272dcade365a, 8e364b2371ed4d5ca79e7899587eff58; no voters: 08:29:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.934806 1894 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.934855 1894 raft_consensus.cc:465] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:27.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.934885 1894 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 0 FOLLOWER]: Advancing to term 1 08:29:27.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.935950 1894 raft_consensus.cc:487] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.936249 1894 leader_election.cc:296] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [CANDIDATE]: Term 1 election: Requested vote from peers fb9a72e6d5544a18bed7c8da3be22ccc (127.1.163.189:46147), 42fedda836824b128b95272dcade365a (127.1.163.188:42515) 08:29:27.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.936610 1854 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8e364b2371ed4d5ca79e7899587eff58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42fedda836824b128b95272dcade365a" 08:29:27.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.936684 1790 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8e364b2371ed4d5ca79e7899587eff58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" 08:29:27.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.936681 1854 raft_consensus.cc:2901] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [term 0 FOLLOWER]: Advancing to term 1 08:29:27.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.936769 1790 raft_consensus.cc:2901] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [term 0 FOLLOWER]: Advancing to term 1 08:29:27.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.937918 1790 raft_consensus.cc:2355] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e364b2371ed4d5ca79e7899587eff58 in term 1. 08:29:27.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.937918 1854 raft_consensus.cc:2355] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e364b2371ed4d5ca79e7899587eff58 in term 1. 08:29:27.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.938271 1697 leader_election.cc:310] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42fedda836824b128b95272dcade365a, 8e364b2371ed4d5ca79e7899587eff58; no voters: 08:29:27.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.938504 1894 raft_consensus.cc:2649] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 1 FOLLOWER]: Leader election won for term 1 08:29:27.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.938686 1894 raft_consensus.cc:660] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [term 1 LEADER]: Becoming Leader. State: Replica: 8e364b2371ed4d5ca79e7899587eff58, State: Running, Role: LEADER 08:29:27.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.939025 1894 consensus_queue.cc:205] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } 08:29:27.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.940456 1894 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e364b2371ed4d5ca79e7899587eff58. Latest consensus state: current_term: 1 leader_uuid: "8e364b2371ed4d5ca79e7899587eff58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.940488 1894 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: This master's current role is: LEADER 08:29:27.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.941043 2163 catalog_manager.cc:1090] Loading table and tablet metadata into memory... 08:29:27.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.942279 2163 catalog_manager.cc:1101] Initializing Kudu internal certificate authority... 08:29:27.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.957497 2149 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go 08:29:27.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.958629 2149 ts_tablet_manager.cc:388] Loaded tablet metadata (0 total tablets, 0 live tablets) 08:29:27.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.958664 2149 ts_tablet_manager.cc:408] Registered 0 tablets 08:29:27.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.966974 2149 rpc_server.cc:211] RPC server started. Bound to: 127.1.163.131:34053 08:29:27.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.968098 2149 webserver.cc:382] Webserver started at http://127.1.163.131:45441/ using document root and password file 08:29:27.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.969116 2149 server_base.cc:633] Dumped server information to /tmp/dist-test-taskHFigEJ/test-tmp/mini-kudu-cluster3355648608703499477/ts-2/data/info.pb 08:29:27.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.973659 1678 external_mini_cluster.cc:1101] Started /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver as pid 2149 08:29:27.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.980880 2274 heartbeater.cc:322] Connected to a master server at 127.1.163.189:46147 08:29:27.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.981357 2274 heartbeater.cc:406] Registering TS with master... 08:29:27.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.981972 2274 heartbeater.cc:455] Master 127.1.163.189:46147 requested a full tablet report, sending... 08:29:27.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.983307 1780 ts_manager.cc:191] Registered new tserver with Master: 302a04508a8c48b8bff5eae9bfed8f70 (127.1.163.131:34053) 08:29:27.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.980899 2273 heartbeater.cc:322] Connected to a master server at 127.1.163.188:42515 08:29:27.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.984022 2273 heartbeater.cc:406] Registering TS with master... 08:29:27.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.984261 2273 heartbeater.cc:455] Master 127.1.163.188:42515 requested a full tablet report, sending... 08:29:27.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.985106 1836 ts_manager.cc:191] Registered new tserver with Master: 302a04508a8c48b8bff5eae9bfed8f70 (127.1.163.131:34053) 08:29:27.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.985198 2275 heartbeater.cc:322] Connected to a master server at 127.1.163.190:35563 08:29:27.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.985280 2275 heartbeater.cc:406] Registering TS with master... 08:29:27.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.985489 2275 heartbeater.cc:455] Master 127.1.163.190:35563 requested a full tablet report, sending... 08:29:27.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.986138 1714 ts_manager.cc:191] Registered new tserver with Master: 302a04508a8c48b8bff5eae9bfed8f70 (127.1.163.131:34053) 08:29:27.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.986562 1854 raft_consensus.cc:1177] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [term 1 FOLLOWER]: Refusing update from remote peer 8e364b2371ed4d5ca79e7899587eff58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:27.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.987277 1894 consensus_queue.cc:981] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:27.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.988410 1790 raft_consensus.cc:1177] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [term 1 FOLLOWER]: Refusing update from remote peer 8e364b2371ed4d5ca79e7899587eff58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:27.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.989089 2161 consensus_queue.cc:981] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.992391 1883 sys_catalog.cc:340] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e364b2371ed4d5ca79e7899587eff58. Latest consensus state: current_term: 1 leader_uuid: "8e364b2371ed4d5ca79e7899587eff58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.992432 1883 sys_catalog.cc:343] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.992606 1887 sys_catalog.cc:340] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e364b2371ed4d5ca79e7899587eff58. Latest consensus state: current_term: 1 leader_uuid: "8e364b2371ed4d5ca79e7899587eff58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.992635 1887 sys_catalog.cc:343] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.995651 2161 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8e364b2371ed4d5ca79e7899587eff58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.995784 2161 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: This master's current role is: LEADER 08:29:27.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.996222 2282 mvcc.cc:203] Tried to move safe_time back from 6445957808063594496 to 6445957807880265728. Current Snapshot: MvccSnapshot[committed={T|T < 6445957808063594496}] 08:29:27.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.996345 1678 external_mini_cluster.cc:717] 3 TS(s) registered with all masters 08:29:27.996 [DEBUG - main] (MiniKuduCluster.java:165) Response: 08:29:27.996 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_masters { } 08:29:27.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.997287 1883 sys_catalog.cc:340] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8e364b2371ed4d5ca79e7899587eff58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.997319 1883 sys_catalog.cc:343] T 00000000000000000000000000000000 P 42fedda836824b128b95272dcade365a [sys.catalog]: This master's current role is: FOLLOWER 08:29:27.997 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_masters { masters { id { type: MASTER index: 0 } bound_rpc_address { host: "127.1.163.190" port: 35563 } } masters { id { type: MASTER index: 1 } bound_rpc_address { host: "127.1.163.189" port: 46147 } } masters { id { type: MASTER index: 2 } bound_rpc_address { host: "127.1.163.188" port: 42515 } } } 08:29:27.998 [DEBUG - main] (MiniKuduCluster.java:155) Request: get_tservers { } 08:29:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.998381 1894 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8e364b2371ed4d5ca79e7899587eff58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.998409 1894 sys_catalog.cc:343] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58 [sys.catalog]: This master's current role is: LEADER 08:29:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.998675 2283 mvcc.cc:203] Tried to move safe_time back from 6445957808063594496 to 6445957807880265728. Current Snapshot: MvccSnapshot[committed={T|T < 6445957808063594496}] 08:29:27.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.999210 2163 catalog_manager.cc:985] Generated new certificate authority record 08:29:27.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.999768 1887 sys_catalog.cc:340] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8e364b2371ed4d5ca79e7899587eff58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e364b2371ed4d5ca79e7899587eff58" member_type: VOTER last_known_addr { host: "127.1.163.190" port: 35563 } } peers { permanent_uuid: "fb9a72e6d5544a18bed7c8da3be22ccc" member_type: VOTER last_known_addr { host: "127.1.163.189" port: 46147 } } peers { permanent_uuid: "42fedda836824b128b95272dcade365a" member_type: VOTER last_known_addr { host: "127.1.163.188" port: 42515 } } } 08:29:27.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:27.999805 1887 sys_catalog.cc:343] T 00000000000000000000000000000000 P fb9a72e6d5544a18bed7c8da3be22ccc [sys.catalog]: This master's current role is: FOLLOWER 08:29:28.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.000624 2163 catalog_manager.cc:1110] Loading token signing keys... 08:29:28.000 [DEBUG - main] (MiniKuduCluster.java:165) Response: get_tservers { tservers { id { type: TSERVER index: 0 } bound_rpc_address { host: "127.1.163.129" port: 33255 } } tservers { id { type: TSERVER index: 1 } bound_rpc_address { host: "127.1.163.130" port: 40657 } } tservers { id { type: TSERVER index: 2 } bound_rpc_address { host: "127.1.163.131" port: 34053 } } } 08:29:28.001 [INFO - main] (KuduTestHarness.java:141) Creating a new Kudu client... 08:29:28.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.013582 2163 catalog_manager.cc:4455] T 00000000000000000000000000000000 P 8e364b2371ed4d5ca79e7899587eff58: Generated new TSK 0 08:29:28.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.014603 2163 catalog_manager.cc:1120] Initializing in-progress tserver states... 08:29:28.019 [DEBUG - main] (SecurityUtil.java:121) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 08:29:28.027 [DEBUG - New I/O worker #91] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.1.163.188 08:29:28.027 [DEBUG - New I/O worker #92] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.1.163.189 08:29:28.028 [DEBUG - New I/O worker #93] (Negotiator.java:460) SASL mechanism PLAIN chosen for peer 127.1.163.190 08:29:28.035 [DEBUG - New I/O worker #92] (Negotiator.java:764) Authenticated connection [id: 0xde8308b9, /127.0.0.1:45902 => /127.1.163.189:46147] using SASL/PLAIN 08:29:28.035 [DEBUG - New I/O worker #93] (Negotiator.java:764) Authenticated connection [id: 0xe26fd8bd, /127.0.0.1:57826 => /127.1.163.190:35563] using SASL/PLAIN 08:29:28.035 [DEBUG - New I/O worker #91] (Negotiator.java:764) Authenticated connection [id: 0x34f5d286, /127.0.0.1:51604 => /127.1.163.188:42515] using SASL/PLAIN 08:29:28.038 [DEBUG - New I/O worker #93] (AsyncKuduClient.java:2346) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 08:29:28.039 [DEBUG - New I/O worker #93] (AsyncKuduClient.java:1313) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=19), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.163.188:42515, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.163.189:46147, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.163.190:35563, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.163.188:42515: OK, [18ms] Sub RPC ConnectToMaster: received response from server master-127.1.163.189:46147: OK, [18ms] Sub RPC ConnectToMaster: received response from server master-127.1.163.190:35563: OK, deferred=null) after lookup 08:29:28.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.041620 1714 catalog_manager.cc:1455] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57826: 08:29:28.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "org.apache.kudu.client.TestAsyncKuduSession" 08:29:28.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) schema { 08:29:28.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:28.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:28.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:28.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: true 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column1_i" 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column2_i" 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: INT32 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column3_s" 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: STRING 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: true 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) encoding: DICT_ENCODING 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) compression: LZ4 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 4096 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "column4_b" 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) type: BOOL 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_key: false 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) is_nullable: false 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) cfile_block_size: 0 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) partition_schema { 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) range_schema { 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) columns { 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) name: "key" 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) } 08:29:28.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:28.042621 1714 catalog_manager.cc:1620] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestAsyncKuduSession in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. 08:29:28.052 [DEBUG - New I/O worker #93] (AsyncKuduClient.java:777) Opened table 0df3068d2a994017b0a7b0bce94c88af 08:29:28.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.065269 2210 tablet_service.cc:1023] Processing CreateTablet for tablet fa21189d1bf8447a91dff39c1a698b70 (table=org.apache.kudu.client.TestAsyncKuduSession [id=0df3068d2a994017b0a7b0bce94c88af]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:28.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.065879 2210 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet fa21189d1bf8447a91dff39c1a698b70. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:28.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.067975 2079 tablet_service.cc:1023] Processing CreateTablet for tablet fa21189d1bf8447a91dff39c1a698b70 (table=org.apache.kudu.client.TestAsyncKuduSession [id=0df3068d2a994017b0a7b0bce94c88af]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:28.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.068603 2079 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet fa21189d1bf8447a91dff39c1a698b70. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:28.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.071643 2306 tablet_bootstrap.cc:439] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70: Bootstrap starting. 08:29:28.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.073721 2306 tablet_bootstrap.cc:590] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70: No blocks or log segments found. Creating new log. 08:29:28.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.074690 2306 log.cc:558] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70: Log is configured to *not* fsync() on all Append() calls 08:29:28.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.076143 2306 tablet_bootstrap.cc:439] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70: No bootstrap required, opened a new log 08:29:28.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.076722 2308 tablet_bootstrap.cc:439] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b: Bootstrap starting. 08:29:28.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.076916 1933 tablet_service.cc:1023] Processing CreateTablet for tablet fa21189d1bf8447a91dff39c1a698b70 (table=org.apache.kudu.client.TestAsyncKuduSession [id=0df3068d2a994017b0a7b0bce94c88af]), partition=RANGE (key) PARTITION UNBOUNDED 08:29:28.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.076958 2306 ts_tablet_manager.cc:1096] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s 08:29:28.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.077754 1933 data_dirs.cc:944] Could only allocate 1 dirs of requested 3 for tablet fa21189d1bf8447a91dff39c1a698b70. 1 dirs total, 0 dirs full, 0 dirs failed 08:29:28.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.079879 2306 raft_consensus.cc:333] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.079982 2306 raft_consensus.cc:359] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:28.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.080026 2306 raft_consensus.cc:698] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 302a04508a8c48b8bff5eae9bfed8f70, State: Initialized, Role: FOLLOWER 08:29:28.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.082123 2308 tablet_bootstrap.cc:590] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b: No blocks or log segments found. Creating new log. 08:29:28.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.083124 2308 log.cc:558] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b: Log is configured to *not* fsync() on all Append() calls 08:29:28.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.084482 2308 tablet_bootstrap.cc:439] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b: No bootstrap required, opened a new log 08:29:28.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.084942 2306 consensus_queue.cc:228] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.085592 2308 ts_tablet_manager.cc:1096] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s 08:29:28.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.086045 2311 tablet_bootstrap.cc:439] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a: Bootstrap starting. 08:29:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.088517 2308 raft_consensus.cc:333] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.088610 2308 raft_consensus.cc:359] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.088650 2308 raft_consensus.cc:698] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64820f6ca27a4083ba3bbfb5af6b1a5b, State: Initialized, Role: FOLLOWER 08:29:28.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.092919 1714 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.1.163.131:53679 08:29:28.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.093858 2306 ts_tablet_manager.cc:1124] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s 08:29:28.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.095716 2311 tablet_bootstrap.cc:590] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a: No blocks or log segments found. Creating new log. 08:29:28.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.096421 2311 log.cc:558] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a: Log is configured to *not* fsync() on all Append() calls 08:29:28.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.094671 2275 heartbeater.cc:447] Master 127.1.163.190:35563 was elected leader, sending a full tablet report... 08:29:28.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.097419 2308 consensus_queue.cc:228] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.101071 1714 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.1.163.130:57439 08:29:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.102982 2308 ts_tablet_manager.cc:1124] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s 08:29:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.103338 2144 heartbeater.cc:447] Master 127.1.163.190:35563 was elected leader, sending a full tablet report... 08:29:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.104451 2311 tablet_bootstrap.cc:439] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a: No bootstrap required, opened a new log 08:29:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.104637 2311 ts_tablet_manager.cc:1096] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s 08:29:28.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.106844 2311 raft_consensus.cc:333] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.106930 2311 raft_consensus.cc:359] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 08:29:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.106968 2311 raft_consensus.cc:698] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d20d304ce8c46e28c8b8d2b6e70248a, State: Initialized, Role: FOLLOWER 08:29:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.107331 2311 consensus_queue.cc:228] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.108467 2311 ts_tablet_manager.cc:1124] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s 08:29:28.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.110776 1714 master_service.cc:351] Signed X509 certificate for tserver {username='slave'} at 127.1.163.129:35825 08:29:28.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.112608 2016 heartbeater.cc:447] Master 127.1.163.190:35563 was elected leader, sending a full tablet report... 08:29:28.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.119662 2313 raft_consensus.cc:465] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 08:29:28.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.119864 2313 raft_consensus.cc:487] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.123642 2313 leader_election.cc:296] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d20d304ce8c46e28c8b8d2b6e70248a (127.1.163.129:33255), 302a04508a8c48b8bff5eae9bfed8f70 (127.1.163.131:34053) 08:29:28.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.127461 1971 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "fa21189d1bf8447a91dff39c1a698b70" candidate_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" is_pre_election: true 08:29:28.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.127713 1971 raft_consensus.cc:2355] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64820f6ca27a4083ba3bbfb5af6b1a5b in term 0. 08:29:28.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.128300 2031 leader_election.cc:310] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d20d304ce8c46e28c8b8d2b6e70248a, 64820f6ca27a4083ba3bbfb5af6b1a5b; no voters: 08:29:28.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.128650 2230 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "fa21189d1bf8447a91dff39c1a698b70" candidate_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "302a04508a8c48b8bff5eae9bfed8f70" is_pre_election: true 08:29:28.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.128871 2230 raft_consensus.cc:2355] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64820f6ca27a4083ba3bbfb5af6b1a5b in term 0. 08:29:28.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.129323 2313 raft_consensus.cc:2649] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 0 FOLLOWER]: Leader pre-election won for term 1 08:29:28.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.129382 2313 raft_consensus.cc:465] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 08:29:28.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.129410 2313 raft_consensus.cc:2901] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 0 FOLLOWER]: Advancing to term 1 08:29:28.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.130867 2313 raft_consensus.cc:487] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.131297 2313 leader_election.cc:296] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [CANDIDATE]: Term 1 election: Requested vote from peers 3d20d304ce8c46e28c8b8d2b6e70248a (127.1.163.129:33255), 302a04508a8c48b8bff5eae9bfed8f70 (127.1.163.131:34053) 08:29:28.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.131840 2230 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "fa21189d1bf8447a91dff39c1a698b70" candidate_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "302a04508a8c48b8bff5eae9bfed8f70" 08:29:28.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.131896 2230 raft_consensus.cc:2901] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70 [term 0 FOLLOWER]: Advancing to term 1 08:29:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.133252 1971 tablet_service.cc:1296] Received RequestConsensusVote() RPC: tablet_id: "fa21189d1bf8447a91dff39c1a698b70" candidate_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" 08:29:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.133338 1971 raft_consensus.cc:2901] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a [term 0 FOLLOWER]: Advancing to term 1 08:29:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.133414 2230 raft_consensus.cc:2355] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64820f6ca27a4083ba3bbfb5af6b1a5b in term 1. 08:29:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.133810 2031 leader_election.cc:310] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 302a04508a8c48b8bff5eae9bfed8f70, 64820f6ca27a4083ba3bbfb5af6b1a5b; no voters: 08:29:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.134016 2313 raft_consensus.cc:2649] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 1 FOLLOWER]: Leader election won for term 1 08:29:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.134241 2313 raft_consensus.cc:660] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [term 1 LEADER]: Becoming Leader. State: Replica: 64820f6ca27a4083ba3bbfb5af6b1a5b, State: Running, Role: LEADER 08:29:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.134572 1971 raft_consensus.cc:2355] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64820f6ca27a4083ba3bbfb5af6b1a5b in term 1. 08:29:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.134601 2313 consensus_queue.cc:205] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } } 08:29:28.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.139783 1714 catalog_manager.cc:4143] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b reported cstate change: term changed from 0 to 1, leader changed from to 64820f6ca27a4083ba3bbfb5af6b1a5b (127.1.163.130). New cstate: current_term: 1 leader_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64820f6ca27a4083ba3bbfb5af6b1a5b" member_type: VOTER last_known_addr { host: "127.1.163.130" port: 40657 } health_report { overall_health: HEALTHY } } } 08:29:28.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) W1114 08:29:28.161975 2017 tablet.cc:1764] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a: Can't schedule compaction. Clean time has not been advanced past its initial value. 08:29:28.183 [DEBUG - main] (AsyncKuduSession.java:447) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1601687801(state=PENDING, result=null, callback=, errback=)} 08:29:28.185 [DEBUG - New I/O worker #93] (AsyncKuduClient.java:2346) Learned about tablet fa21189d1bf8447a91dff39c1a698b70 for table 'org.apache.kudu.client.TestAsyncKuduSession' with partition [, ) 08:29:28.185 [DEBUG - New I/O worker #93] (TableLocationsCache.java:188) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=fa21189d1bf8447a91dff39c1a698b70@[302a04508a8c48b8bff5eae9bfed8f70(127.1.163.131:34053),3d20d304ce8c46e28c8b8d2b6e70248a(127.1.163.129:33255),64820f6ca27a4083ba3bbfb5af6b1a5b(127.1.163.130:40657)[L]]}] 08:29:28.195 [DEBUG - New I/O worker #94] (Negotiator.java:764) Authenticated connection [id: 0x78630522, /127.0.0.1:58140 => /127.1.163.130:40657] using TOKEN/null 08:29:28.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.201550 2230 raft_consensus.cc:1177] T fa21189d1bf8447a91dff39c1a698b70 P 302a04508a8c48b8bff5eae9bfed8f70 [term 1 FOLLOWER]: Refusing update from remote peer 64820f6ca27a4083ba3bbfb5af6b1a5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:28.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.201756 1971 raft_consensus.cc:1177] T fa21189d1bf8447a91dff39c1a698b70 P 3d20d304ce8c46e28c8b8d2b6e70248a [term 1 FOLLOWER]: Refusing update from remote peer 64820f6ca27a4083ba3bbfb5af6b1a5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 08:29:28.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.202219 2315 consensus_queue.cc:981] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "302a04508a8c48b8bff5eae9bfed8f70" member_type: VOTER last_known_addr { host: "127.1.163.131" port: 34053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:28.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.202414 2313 consensus_queue.cc:981] T fa21189d1bf8447a91dff39c1a698b70 P 64820f6ca27a4083ba3bbfb5af6b1a5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d20d304ce8c46e28c8b8d2b6e70248a" member_type: VOTER last_known_addr { host: "127.1.163.129" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s 08:29:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.216272 2320 mvcc.cc:203] Tried to move safe_time back from 6445957808946741248 to 6445957808681586688. Current Snapshot: MvccSnapshot[committed={T|T < 6445957808946741248 or (T in {6445957808946741248})}] 08:29:28.218 [DEBUG - New I/O worker #92] (Connection.java:691) [peer master-127.1.163.189:46147(127.1.163.189:46147)] cleaning up while in state READY due to: connection disconnected 08:29:28.219 [DEBUG - New I/O worker #93] (Connection.java:691) [peer master-127.1.163.190:35563(127.1.163.190:35563)] cleaning up while in state READY due to: connection disconnected 08:29:28.221 [DEBUG - New I/O worker #91] (Connection.java:691) [peer master-127.1.163.188:42515(127.1.163.188:42515)] cleaning up while in state READY due to: connection disconnected 08:29:28.221 [DEBUG - New I/O worker #94] (Connection.java:691) [peer 64820f6ca27a4083ba3bbfb5af6b1a5b(127.1.163.130:40657)] cleaning up while in state READY due to: connection disconnected 08:29:28.222 [DEBUG - New I/O worker #94] (AsyncKuduClient.java:2511) Releasing all remaining resources 08:29:28.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.222968 1678 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 1880 08:29:28.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.228601 1678 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 2021 08:29:28.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.235149 1678 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-tserver with pid 2149 08:29:28.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.239193 1678 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 1687 08:29:28.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.243343 1678 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 1750 08:29:28.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) I1114 08:29:28.247407 1678 external_mini_cluster.cc:1237] Killing /tmp/dist-test-taskHFigEJ/build/debug/bin/kudu-master with pid 1814 08:29:28.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:543) 2019-11-14T08:29:28Z chronyd exiting Time: 22.248 There was 1 failure: 1) testTabletCacheInvalidatedDuringWrites(org.apache.kudu.client.TestAsyncKuduSession) org.apache.kudu.client.PleaseThrottleException: all buffers are currently flushing at org.apache.kudu.client.AsyncKuduSession.apply(AsyncKuduSession.java:579) at org.apache.kudu.client.TestAsyncKuduSession.testTabletCacheInvalidatedDuringWrites(TestAsyncKuduSession.java:371) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) FAILURES!!! Tests run: 11, Failures: 1