03:46:25.082 [INFO - main] (BaseKuduTest.java:75) Setting up before class... 03:46:25.129 [INFO - main] (MiniKuduCluster.java:152) Starting 3 masters... 03:46:25.680 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:25.681 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:25.633622 18349 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:25.682 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:25.635061 18349 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:25.682 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:25.635085 18349 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:25.682 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:25.635094 18349 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:25.682 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:25.635125 18349 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:25.684 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.637001 18349 master_main.cc:66] Master server non-default flags: 03:46:25.684 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:25.684 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:25.684 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706385213/data 03:46:25.684 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706385213/data 03:46:25.685 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:25.687 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:25.687 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:25.707 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:25.708 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64030 03:46:25.708 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:25.708 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_port=64031 03:46:25.708 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --never_fsync=true 03:46:25.709 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.18349 03:46:25.709 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:25.710 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:25.711 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:25.711 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:25.711 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706385213/logs 03:46:25.711 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --logtostderr=true 03:46:25.712 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Master server version: 03:46:25.712 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:25.713 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:25.713 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build type DEBUG 03:46:25.713 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:25.713 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build id 9998 03:46:25.714 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.665194 18349 minidump.cc:237] Setting minidump size limit to 20M 03:46:25.714 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.700702 18349 master_main.cc:73] Initializing master server... 03:46:25.714 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.701478 18349 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 436829 03:46:25.719 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.719192 18349 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706385213/data/instance: No such file or directory (error 2) 03:46:25.719 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.719637 18349 server_base.cc:229] Creating new FS layout 03:46:25.724 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.724225 18349 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706385213/data/instance: 03:46:25.724 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "c28360c4a2f042f6ba87fd09b4d2171c" 03:46:25.724 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:25 on jenkins-slave-c3oe" 03:46:25.801 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.801405 18349 fs_manager.cc:431] Time spent creating directory manager: real 0.041s user 0.004s sys 0.000s 03:46:25.807 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.807346 18349 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:25.807 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.807548 18349 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:25.833 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.833632 18349 fs_manager.cc:335] Time spent opening block manager: real 0.024s user 0.000s sys 0.000s 03:46:25.834 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.834354 18349 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706385213/data 03:46:25.834 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "c28360c4a2f042f6ba87fd09b4d2171c" 03:46:25.834 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:25 on jenkins-slave-c3oe" 03:46:25.834 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.834946 18349 fs_report.cc:347] Block manager report 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) -------------------- 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706385213/data/data 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:25.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:25.836 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:25.836 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:25.836 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:25.933 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.933205 18349 master_main.cc:76] Starting Master server... 03:46:25.934 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.934643 18432 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:25.935 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.934669 18432 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:25.935 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:25.934675 18432 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:26.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:26.112 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.106596 18444 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:26.114 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.114440 18444 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:26.114 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.114904 18444 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:26.115 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.115196 18444 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:26.115 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.115514 18444 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:26.117 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.117738 18444 master_main.cc:66] Master server non-default flags: 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706385213/data 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706385213/data 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:26.118 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64032 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_port=64033 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --never_fsync=true 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.18444 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:26.119 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706385213/logs 03:46:26.120 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --logtostderr=true 03:46:26.120 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Master server version: 03:46:26.120 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:26.120 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:26.122 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build type DEBUG 03:46:26.122 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:26.122 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build id 9998 03:46:26.149 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.149298 18444 minidump.cc:237] Setting minidump size limit to 20M 03:46:26.184 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.184717 18444 master_main.cc:73] Initializing master server... 03:46:26.186 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.186048 18444 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 437329 03:46:26.191 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.191509 18444 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706385213/data/instance: No such file or directory (error 2) 03:46:26.195 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.195834 18444 server_base.cc:229] Creating new FS layout 03:46:26.200 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.200636 18444 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706385213/data/instance: 03:46:26.200 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" 03:46:26.201 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:26 on jenkins-slave-c3oe" 03:46:26.229 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.229828 18444 fs_manager.cc:431] Time spent creating directory manager: real 0.028s user 0.004s sys 0.004s 03:46:26.230 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.230919 18444 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:26.232 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.232468 18444 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:26.246 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.245893 18444 fs_manager.cc:335] Time spent opening block manager: real 0.011s user 0.004s sys 0.000s 03:46:26.246 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.246613 18444 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706385213/data 03:46:26.246 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" 03:46:26.246 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:26 on jenkins-slave-c3oe" 03:46:26.247 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.247203 18444 fs_report.cc:347] Block manager report 03:46:26.247 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) -------------------- 03:46:26.247 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706385213/data/data 03:46:26.247 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:26.247 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:26.247 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:26.247 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:26.247 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:26.248 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:26.248 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:26.248 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:26.248 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:26.248 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:26.386 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.384668 18349 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64030 03:46:26.386 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.385072 18349 webserver.cc:149] Starting webserver on 127.70.237.1:64031 03:46:26.386 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.385093 18349 webserver.cc:160] Document root disabled 03:46:26.386 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.385584 18349 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64031/ 03:46:26.386 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.386402 18444 master_main.cc:76] Starting Master server... 03:46:26.388 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.387207 18602 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:26.388 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.387226 18602 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:26.389 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.387233 18602 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:26.399 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.399806 18601 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.404 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:26.405 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:26.404670 18570 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:26.406 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:26.406847 18570 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:26.407 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:26.407233 18570 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:26.407 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:26.407537 18570 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:26.407 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:26.407941 18570 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.410032 18570 master_main.cc:66] Master server non-default flags: 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706385213/data 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706385213/data 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:26.410 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64034 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_port=64035 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --never_fsync=true 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.18570 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706385213/logs 03:46:26.411 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --logtostderr=true 03:46:26.412 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Master server version: 03:46:26.412 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:26.412 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:26.412 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build type DEBUG 03:46:26.412 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:26.412 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build id 9998 03:46:26.433 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.433804 18601 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.435 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:26.435194 18601 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:26.465 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.464995 18570 minidump.cc:237] Setting minidump size limit to 20M 03:46:26.476 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.476778 18601 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 1 03:46:26.478 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:26.478232 18601 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:26.481 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.481350 18444 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64032 03:46:26.482 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.482121 18444 webserver.cc:149] Starting webserver on 127.70.237.1:64033 03:46:26.482 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.482429 18444 webserver.cc:160] Document root disabled 03:46:26.483 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.483197 18444 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64033/ 03:46:26.491 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.490875 18678 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.497 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.496999 18570 master_main.cc:73] Initializing master server... 03:46:26.497 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.497658 18570 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 437329 03:46:26.503 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.503268 18570 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706385213/data/instance: No such file or directory (error 2) 03:46:26.503 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.503309 18570 server_base.cc:229] Creating new FS layout 03:46:26.504 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.504149 18678 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.507 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.507408 18570 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706385213/data/instance: 03:46:26.507 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" 03:46:26.507 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:26 on jenkins-slave-c3oe" 03:46:26.523 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.523012 18601 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 2 03:46:26.528 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.528153 18678 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.529 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.529150 18678 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:26.542 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.541891 18601 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.543 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:26.543301 18601 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:26.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.545678 18570 fs_manager.cc:431] Time spent creating directory manager: real 0.038s user 0.008s sys 0.000s 03:46:26.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.546187 18570 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:26.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.546375 18570 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:26.561 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.561615 18570 fs_manager.cc:335] Time spent opening block manager: real 0.013s user 0.000s sys 0.000s 03:46:26.562 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.561777 18570 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706385213/data 03:46:26.562 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" 03:46:26.562 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:26 on jenkins-slave-c3oe" 03:46:26.562 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.561851 18570 fs_report.cc:347] Block manager report 03:46:26.562 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) -------------------- 03:46:26.562 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706385213/data/data 03:46:26.562 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:26.563 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:26.562 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.562381 18678 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 1 03:46:26.564 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.563546 18678 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:26.608 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.607498 18601 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 1 03:46:26.608 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.608772 18678 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 2 03:46:26.609 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:26.609658 18601 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:26.610 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.610357 18678 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:26.652 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.651854 18601 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 2 03:46:26.653 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:26.653300 18601 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:26.660 [INFO - main] (MiniKuduCluster.java:155) Starting 3 tablet servers... 03:46:26.720 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.720527 18678 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 3 03:46:26.722 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:26.722439 18678 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:26.763 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.763474 18601 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 3 03:46:26.765 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:26.764966 18601 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:26.777 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:26.777 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:26.777102 18731 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:26.778 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:26.778208 18731 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:26.778 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:26.778257 18731 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:26.778 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:26.778280 18731 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:26.779 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.779872 18731 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64036 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:26.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.18731 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/logs 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:26.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:26.783 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type DEBUG 03:46:26.783 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:26.784 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 9998 03:46:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.793205 18570 master_main.cc:76] Starting Master server... 03:46:26.811 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.810968 18769 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:26.811 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.811008 18769 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:26.811 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.811014 18769 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:26.836 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.836164 18570 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64034 03:46:26.836 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.836567 18570 webserver.cc:149] Starting webserver on 127.70.237.1:64035 03:46:26.836 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.836585 18570 webserver.cc:160] Document root disabled 03:46:26.837 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.837064 18570 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64035/ 03:46:26.848 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.848492 18731 minidump.cc:237] Setting minidump size limit to 20M 03:46:26.851 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.851649 18826 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.869 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.869567 18826 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.877 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.877616 18678 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 4 03:46:26.886 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.886706 18826 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:26.888 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.888676 18731 tablet_server_main.cc:79] Initializing tablet server... 03:46:26.889 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.889493 18731 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 437329 03:46:26.910 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.910265 18731 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data/instance: No such file or directory (error 2) 03:46:26.910 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.910313 18731 server_base.cc:229] Creating new FS layout 03:46:26.914 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.914595 18731 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data/instance: 03:46:26.914 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "b5851213ca55407284d76a9cea74db72" 03:46:26.915 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:26 on jenkins-slave-c3oe" 03:46:26.930 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.930783 18678 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b: Bootstrap starting. 03:46:26.932 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.932828 18678 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b: No blocks or log segments found. Creating new log. 03:46:26.933 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.933642 18678 log.cc:518] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b: Log is configured to *not* fsync() on all Append() calls 03:46:26.940 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.940680 18826 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Bootstrap starting. 03:46:26.941 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.941509 18678 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b: No bootstrap required, opened a new log 03:46:26.942 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.942140 18601 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 4 03:46:26.943 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.942987 18826 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: No blocks or log segments found. Creating new log. 03:46:26.943 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.943202 18678 raft_consensus.cc:287] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:26.943 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.943516 18678 raft_consensus.cc:313] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:26.944 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.943997 18678 raft_consensus.cc:576] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4b6ddb6610f47b29c015ad4cb1a968b, State: Initialized, Role: FOLLOWER 03:46:26.944 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.944034 18826 log.cc:518] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Log is configured to *not* fsync() on all Append() calls 03:46:26.944 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.944557 18678 consensus_queue.cc:190] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:26.954 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.951016 18601 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c: Bootstrap starting. 03:46:26.954 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.953032 18601 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c: No blocks or log segments found. Creating new log. 03:46:26.954 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.953830 18601 log.cc:518] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c: Log is configured to *not* fsync() on all Append() calls 03:46:26.955 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.955799 18826 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: No bootstrap required, opened a new log 03:46:26.957 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.957332 18826 raft_consensus.cc:287] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:26.957 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.957401 18826 raft_consensus.cc:313] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:26.958 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.958484 18601 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c: No bootstrap required, opened a new log 03:46:26.960 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.959965 18601 raft_consensus.cc:287] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:26.960 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.960285 18601 raft_consensus.cc:313] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:26.960 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.960711 18678 sys_catalog.cc:321] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:26.960 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.960860 18601 raft_consensus.cc:576] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c28360c4a2f042f6ba87fd09b4d2171c, State: Initialized, Role: FOLLOWER 03:46:26.961 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.961026 18601 consensus_queue.cc:190] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:26.961 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.961261 18678 sys_catalog.cc:324] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: This master's current role is: FOLLOWER 03:46:26.961 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.961331 18826 raft_consensus.cc:576] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3c210fb3054825a9fdb0c1d31e0e2b, State: Initialized, Role: FOLLOWER 03:46:26.961 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.961566 18826 consensus_queue.cc:190] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:26.962 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.962589 18678 sys_catalog.cc:408] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: configured and running, proceeding with master startup. 03:46:26.963 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.963096 18850 sys_catalog.cc:321] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:26.963 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.963380 18850 sys_catalog.cc:324] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: This master's current role is: FOLLOWER 03:46:26.966 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.962978 18731 fs_manager.cc:431] Time spent creating directory manager: real 0.048s user 0.004s sys 0.000s 03:46:26.966 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.963500 18731 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:26.966 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.963677 18731 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:26.968 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.968771 18601 sys_catalog.cc:321] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:26.969 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.969085 18601 sys_catalog.cc:324] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: This master's current role is: FOLLOWER 03:46:26.970 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.970229 18601 sys_catalog.cc:408] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: configured and running, proceeding with master startup. 03:46:26.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.970595 18826 sys_catalog.cc:321] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:26.970 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.970818 18858 sys_catalog.cc:321] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:26.971 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.971066 18826 sys_catalog.cc:324] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [sys.catalog]: This master's current role is: FOLLOWER 03:46:26.971 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.971164 18858 sys_catalog.cc:324] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: This master's current role is: FOLLOWER 03:46:26.972 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.972033 18826 sys_catalog.cc:408] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [sys.catalog]: configured and running, proceeding with master startup. 03:46:26.972 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.971019 18859 sys_catalog.cc:321] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:26.972 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.972575 18861 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 03:46:26.972 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.972643 18859 sys_catalog.cc:324] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [sys.catalog]: This master's current role is: FOLLOWER 03:46:26.973 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.973042 18869 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 03:46:26.973 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.973029 18444 master_main.cc:79] Master server successfully started. 03:46:26.973 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.973330 18570 master_main.cc:79] Master server successfully started. 03:46:26.984 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:26.984773 18349 master_main.cc:79] Master server successfully started. 03:46:26.996 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.995421 18859 raft_consensus.cc:412] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:26.997 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.995512 18859 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Snoozing failure detection for 0.813s (starting election) 03:46:26.997 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.995625 18859 raft_consensus.cc:434] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:26.997 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.996358 18859 leader_election.cc:221] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer c28360c4a2f042f6ba87fd09b4d2171c 03:46:26.997 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:26.996636 18859 leader_election.cc:221] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer a4b6ddb6610f47b29c015ad4cb1a968b 03:46:27.000 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.999518 18655 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" is_pre_election: true 03:46:27.000 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.999714 18655 raft_consensus.cc:2456] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b: Snoozing failure detection for 0.767s (vote granted) 03:46:27.000 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:26.999768 18655 raft_consensus.cc:2010] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3c210fb3054825a9fdb0c1d31e0e2b in term 0. 03:46:27.000 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.992835 18731 fs_manager.cc:335] Time spent opening block manager: real 0.027s user 0.004s sys 0.000s 03:46:27.000 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.993018 18731 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:27.000 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "b5851213ca55407284d76a9cea74db72" 03:46:27.000 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:26 on jenkins-slave-c3oe" 03:46:27.001 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:26.993095 18731 fs_report.cc:347] Block manager report 03:46:27.001 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.000886 18718 leader_election.cc:353] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 pre-election: Vote granted by peer a4b6ddb6610f47b29c015ad4cb1a968b 03:46:27.001 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.000932 18718 leader_election.cc:248] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:27.001 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.001277 18859 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Snoozing failure detection for 0.870s (election complete) 03:46:27.001 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.001319 18859 raft_consensus.cc:2280] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:27.001 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.001341 18859 raft_consensus.cc:412] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:27.001 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.001355 18859 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Snoozing failure detection for 0.815s (starting election) 03:46:27.003 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.001368 18859 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 0 FOLLOWER]: Advancing to term 1 03:46:27.003 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.002414 18859 raft_consensus.cc:434] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:27.004 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.002713 18859 leader_election.cc:221] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 election: Requesting vote from peer c28360c4a2f042f6ba87fd09b4d2171c 03:46:27.004 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.002802 18859 leader_election.cc:221] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 election: Requesting vote from peer a4b6ddb6610f47b29c015ad4cb1a968b 03:46:27.004 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.003309 18655 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" 03:46:27.004 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.003384 18655 raft_consensus.cc:2508] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [term 0 FOLLOWER]: Advancing to term 1 03:46:27.004 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.003466 18655 raft_consensus.cc:2456] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b: Snoozing failure detection for 0.623s (vote granted) 03:46:27.004 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.004309 18655 raft_consensus.cc:2010] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3c210fb3054825a9fdb0c1d31e0e2b in term 1. 03:46:27.009 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.005136 18718 leader_election.cc:353] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 election: Vote granted by peer a4b6ddb6610f47b29c015ad4cb1a968b 03:46:27.009 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.005165 18718 leader_election.cc:248] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:27.009 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.008697 18732 leader_election.cc:353] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 pre-election: Vote granted by peer c28360c4a2f042f6ba87fd09b4d2171c 03:46:27.009 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.008952 18732 leader_election.cc:353] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [CANDIDATE]: Term 1 election: Vote granted by peer c28360c4a2f042f6ba87fd09b4d2171c 03:46:27.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.006793 18511 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" is_pre_election: true 03:46:27.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.006985 18511 raft_consensus.cc:2456] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c: Snoozing failure detection for 0.855s (vote granted) 03:46:27.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.007032 18511 raft_consensus.cc:2010] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3c210fb3054825a9fdb0c1d31e0e2b in term 0. 03:46:27.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.007398 18505 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" 03:46:27.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.007446 18505 raft_consensus.cc:2508] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [term 0 FOLLOWER]: Advancing to term 1 03:46:27.010 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.007516 18505 raft_consensus.cc:2456] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c: Snoozing failure detection for 0.679s (vote granted) 03:46:27.010 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.008350 18505 raft_consensus.cc:2010] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3c210fb3054825a9fdb0c1d31e0e2b in term 1. 03:46:27.010 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.010298 18859 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Snoozing failure detection for 0.618s (election complete) 03:46:27.010 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.010347 18859 raft_consensus.cc:2280] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 1 FOLLOWER]: Leader election won for term 1 03:46:27.001 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 03:46:27.013 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data/data 03:46:27.013 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:27.013 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:27.014 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:27.014 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:27.014 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:27.014 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:27.014 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:27.015 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:27.015 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:27.015 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:27.026 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.023977 18859 raft_consensus.cc:542] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [term 1 LEADER]: Becoming Leader. State: Replica: 2c3c210fb3054825a9fdb0c1d31e0e2b, State: Running, Role: LEADER 03:46:27.026 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.024224 18859 consensus_queue.cc:169] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:27.031 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.031524 18883 sys_catalog.cc:321] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c3c210fb3054825a9fdb0c1d31e0e2b. Latest consensus state: current_term: 1 leader_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:27.032 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.031978 18883 sys_catalog.cc:324] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [sys.catalog]: This master's current role is: LEADER 03:46:27.032 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.032634 18897 catalog_manager.cc:948] Loading table and tablet metadata into memory... 03:46:27.038 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.038455 18897 catalog_manager.cc:959] Initializing Kudu internal certificate authority... 03:46:27.087 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:27.088 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:27.087713 18882 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:27.088 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:27.088865 18882 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:27.089 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:27.088906 18882 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:27.089 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:27.088928 18882 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:27.091 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.090553 18882 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:27.097 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.097316 18731 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:27.101 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:27.101 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:27.102 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:27.102 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:27.103 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64038 03:46:27.103 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:27.103 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 03:46:27.103 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:27.103 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:27.103 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.102244 18731 tablet_server_main.cc:84] Starting tablet server... 03:46:27.103 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 03:46:27.103 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.18882 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/logs 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:27.104 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:27.105 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type DEBUG 03:46:27.105 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:27.105 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 9998 03:46:27.105 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.101362 18882 minidump.cc:237] Setting minidump size limit to 20M 03:46:27.110 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.110795 18882 tablet_server_main.cc:79] Initializing tablet server... 03:46:27.111 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.111443 18882 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 437829 03:46:27.140 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.140614 18655 raft_consensus.cc:964] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [term 1 FOLLOWER]: Refusing update from remote peer 2c3c210fb3054825a9fdb0c1d31e0e2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:27.142 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.141769 18883 consensus_queue.cc:741] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [LEADER]: Connected to new peer: Peer: a4b6ddb6610f47b29c015ad4cb1a968b, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:27.142 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.142096 18882 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data/instance: No such file or directory (error 2) 03:46:27.142 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.142134 18882 server_base.cc:229] Creating new FS layout 03:46:27.146 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.146235 18882 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data/instance: 03:46:27.146 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "a3f9940e383340d9b9cf3adbabf5612d" 03:46:27.146 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:27 on jenkins-slave-c3oe" 03:46:27.147 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.146595 18505 raft_consensus.cc:964] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [term 1 FOLLOWER]: Refusing update from remote peer 2c3c210fb3054825a9fdb0c1d31e0e2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:27.147 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.147691 18883 consensus_queue.cc:741] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b [LEADER]: Connected to new peer: Peer: c28360c4a2f042f6ba87fd09b4d2171c, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:27.205 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.205508 18882 fs_manager.cc:431] Time spent creating directory manager: real 0.059s user 0.008s sys 0.000s 03:46:27.206 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.206087 18882 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:27.206 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.206302 18882 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:27.214 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.214417 18850 sys_catalog.cc:321] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c3c210fb3054825a9fdb0c1d31e0e2b. Latest consensus state: current_term: 1 leader_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:27.214 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.214455 18850 sys_catalog.cc:324] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: This master's current role is: FOLLOWER 03:46:27.215 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.215505 18858 sys_catalog.cc:321] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c3c210fb3054825a9fdb0c1d31e0e2b. Latest consensus state: current_term: 1 leader_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:27.215 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.215534 18858 sys_catalog.cc:324] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: This master's current role is: FOLLOWER 03:46:27.220 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.220580 18858 sys_catalog.cc:321] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:27.220 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.220608 18858 sys_catalog.cc:324] T 00000000000000000000000000000000 P c28360c4a2f042f6ba87fd09b4d2171c [sys.catalog]: This master's current role is: FOLLOWER 03:46:27.222 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.221681 18882 fs_manager.cc:335] Time spent opening block manager: real 0.013s user 0.004s sys 0.000s 03:46:27.222 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.221843 18882 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:27.222 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "a3f9940e383340d9b9cf3adbabf5612d" 03:46:27.222 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:27 on jenkins-slave-c3oe" 03:46:27.222 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.221916 18882 fs_report.cc:347] Block manager report 03:46:27.222 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 03:46:27.222 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data/data 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:27.223 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:27.232 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.225476 18897 catalog_manager.cc:846] Generated new certificate authority record 03:46:27.232 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.226784 18897 catalog_manager.cc:968] Loading token signing keys... 03:46:27.239 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.239537 18897 catalog_manager.cc:3544] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Generated new TSK 0 03:46:27.281 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.281476 18850 sys_catalog.cc:321] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c28360c4a2f042f6ba87fd09b4d2171c" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "a4b6ddb6610f47b29c015ad4cb1a968b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "2c3c210fb3054825a9fdb0c1d31e0e2b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:27.281 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.281509 18850 sys_catalog.cc:324] T 00000000000000000000000000000000 P a4b6ddb6610f47b29c015ad4cb1a968b [sys.catalog]: This master's current role is: FOLLOWER 03:46:27.296 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.296718 18731 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64036 03:46:27.297 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.297106 18731 webserver.cc:149] Starting webserver on 127.70.237.1:64037 03:46:27.297 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.297407 18731 webserver.cc:160] Document root disabled 03:46:27.298 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.298125 18731 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64037/ 03:46:27.301 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.301347 19128 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:27.301 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.301673 19128 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:27.302 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.302024 18731 tablet_server_main.cc:87] Tablet server successfully started. 03:46:27.302 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.302269 19128 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:27.314 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.314106 18882 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:27.314 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.314327 18882 tablet_server_main.cc:84] Starting tablet server... 03:46:27.324 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.323997 18882 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64038 03:46:27.324 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.324379 18882 webserver.cc:149] Starting webserver on 127.70.237.1:64039 03:46:27.324 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.324647 18882 webserver.cc:160] Document root disabled 03:46:27.325 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.325342 18882 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64039/ 03:46:27.332 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.332612 18882 tablet_server_main.cc:87] Tablet server successfully started. 03:46:27.333 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.332572 19256 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:27.333 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.333202 19256 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:27.333 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.333374 19256 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:27.352 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.351919 19121 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:27.352 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.352084 19121 heartbeater.cc:387] Registering TS with master... 03:46:27.353 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.352988 19121 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:27.355 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.355268 18645 ts_manager.cc:81] Registered new tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:27.359 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.359336 19248 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:27.359 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.359493 19248 heartbeater.cc:387] Registering TS with master... 03:46:27.361 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.361019 18472 ts_manager.cc:81] Registered new tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:27.361 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.359871 19248 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:27.367 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.367807 18472 ts_manager.cc:81] Registered new tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:27.369 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.368088 18790 ts_manager.cc:81] Registered new tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:27.370 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.369405 18790 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:50565 03:46:27.370 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.366981 19122 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:27.370 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.367043 19122 heartbeater.cc:387] Registering TS with master... 03:46:27.370 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.367074 19120 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:27.370 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.367113 19120 heartbeater.cc:387] Registering TS with master... 03:46:27.370 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.367213 19122 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:27.370 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:27.367229 19120 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:27.371 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.371839 19253 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:27.372 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.371898 19253 heartbeater.cc:387] Registering TS with master... 03:46:27.372 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.372061 19253 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:27.373 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.372613 18790 ts_manager.cc:81] Registered new tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:27.373 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.373347 18790 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:60214 03:46:27.379 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.379842 19249 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:27.380 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.379899 19249 heartbeater.cc:387] Registering TS with master... 03:46:27.380 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:27.380038 19249 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:27.380 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.380726 18645 ts_manager.cc:81] Registered new tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:27.427 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:27.427 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:27.426831 19262 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:27.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:27.427954 19262 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:27.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:27.427994 19262 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:27.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:27.428016 19262 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:27.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.429603 19262 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:27.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:27.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:27.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:27.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:27.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64040 03:46:27.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:27.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.19262 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/logs 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:27.441 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type DEBUG 03:46:27.442 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:27.442 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 9998 03:46:27.442 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.437435 19262 minidump.cc:237] Setting minidump size limit to 20M 03:46:27.498 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.497767 19262 tablet_server_main.cc:79] Initializing tablet server... 03:46:27.499 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.498482 19262 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 437829 03:46:27.504 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.503000 19262 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data/instance: No such file or directory (error 2) 03:46:27.505 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.503032 19262 server_base.cc:229] Creating new FS layout 03:46:27.508 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.507894 19262 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data/instance: 03:46:27.508 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "f6712fb9e95d482d881d3f8c58936d42" 03:46:27.508 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:27 on jenkins-slave-c3oe" 03:46:27.576 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.573721 19262 fs_manager.cc:431] Time spent creating directory manager: real 0.066s user 0.004s sys 0.004s 03:46:27.576 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.574249 19262 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:27.576 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.574434 19262 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.609778 19262 fs_manager.cc:335] Time spent opening block manager: real 0.032s user 0.004s sys 0.000s 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.609944 19262 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "f6712fb9e95d482d881d3f8c58936d42" 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:27 on jenkins-slave-c3oe" 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.610013 19262 fs_report.cc:347] Block manager report 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data/data 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:27.613 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:27.614 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:27.614 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:27.614 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:27.614 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:27.614 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:27.614 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:27.614 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:27.614 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:27.720 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.714720 19262 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:27.721 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.720468 19262 tablet_server_main.cc:84] Starting tablet server... 03:46:27.756 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 03:46:27.769 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.769587 19262 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64040 03:46:27.770 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.770412 19262 webserver.cc:149] Starting webserver on 127.70.237.1:64041 03:46:27.770 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.770676 19262 webserver.cc:160] Document root disabled 03:46:27.771 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.771414 19262 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64041/ 03:46:27.793 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.793277 19525 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:27.794 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.793376 19262 tablet_server_main.cc:87] Tablet server successfully started. 03:46:27.794 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.794498 19525 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:27.794 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.794716 19525 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:27.804 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.803571 19515 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:27.804 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.803741 19515 heartbeater.cc:387] Registering TS with master... 03:46:27.804 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.804152 19515 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:27.808 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:27.808010 18472 ts_manager.cc:81] Registered new tserver with Master: f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040) 03:46:27.847 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.846676 19522 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:27.847 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.846740 19522 heartbeater.cc:387] Registering TS with master... 03:46:27.847 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.846909 19522 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:27.848 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:27.848197 18645 ts_manager.cc:81] Registered new tserver with Master: f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040) 03:46:27.851 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.850225 18790 ts_manager.cc:81] Registered new tserver with Master: f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040) 03:46:27.851 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:27.851006 18790 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:59802 03:46:27.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.849541 19523 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:27.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.849582 19523 heartbeater.cc:387] Registering TS with master... 03:46:27.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:27.849717 19523 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:28.372 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:28.372277 19122 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:28.375 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:28.375160 19253 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:28.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:28.853495 19523 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:28.860 [INFO - main] (BaseKuduTest.java:117) Creating new Kudu client... 03:46:28.870 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 03:46:29.030 [INFO - main] (BaseKuduTest.java:123) Waiting for tablet servers... 03:46:29.741 [DEBUG - New I/O worker #2] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:29.742 [DEBUG - New I/O worker #3] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:29.742 [DEBUG - New I/O worker #1] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:30.186 [DEBUG - New I/O worker #3] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 03:46:30.188 [DEBUG - New I/O worker #3] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=952), Traces: [0ms] querying master, [155ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64030, [341ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64032, [349ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64034, [792ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64030 response OK, [793ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64034 response OK, [791ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64032 response OK, null) after lookup 03:46:30.193 [DEBUG - New I/O worker #3] (Deferred.java:1330) callback=retry RPC@154305230 returned Deferred@304807955(state=PENDING, result=null, callback=(continuation of Deferred@662344652 after retry RPC@154305230), errback=(continuation of Deferred@662344652 after retry RPC@154305230)), so the following Deferred is getting paused: Deferred@662344652(state=PAUSED, result=Deferred@304807955, callback=wakeup thread main, errback=wakeup thread main) 03:46:30.355 [INFO - main] (BaseKuduTest.java:131) Creating table: org.apache.kudu.client.TestAsyncKuduSession-1505706385081 03:46:30.373 [DEBUG - New I/O worker #66] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:30.401 [DEBUG - New I/O worker #67] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:30.412 [DEBUG - New I/O worker #68] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:30.492 [DEBUG - New I/O worker #68] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 03:46:30.493 [DEBUG - New I/O worker #68] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=136), Traces: [0ms] querying master, [11ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64030, [23ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64032, [43ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64034, [58ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64030 response OK, [126ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64032 response OK, [133ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64034 response OK, null) after lookup 03:46:30.523 [DEBUG - New I/O worker #68] (Deferred.java:1330) callback=retry RPC@28302683 returned Deferred@1152209674(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after retry RPC@28302683), errback=(continuation of Deferred@1920815962 after retry RPC@28302683)), so the following Deferred is getting paused: Deferred@1920815962(state=PAUSED, result=Deferred@1152209674, callback=org.apache.kudu.client.AsyncKuduClient$1@75a3d5f5 -> org.apache.kudu.client.AsyncKuduClient$2@a998b1f -> wakeup thread main, errback=passthrough -> passthrough -> wakeup thread main) 03:46:30.569 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:30.569398 18790 catalog_manager.cc:1211] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:41428: 03:46:30.570 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "org.apache.kudu.client.TestAsyncKuduSession-1505706385081" 03:46:30.570 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) schema { 03:46:30.570 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:30.570 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:30.570 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:30.570 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: true 03:46:30.570 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column1_i" 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column2_i" 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column3_s" 03:46:30.571 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: STRING 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: true 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) compression: LZ4 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 4096 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column4_b" 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: BOOL 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) partition_schema { 03:46:30.572 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) range_schema { 03:46:30.573 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:30.573 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:30.573 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.573 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.573 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:30.596 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.595738 18978 tablet_service.cc:764] Processing CreateTablet for tablet c44211462fbc43959f0265b9662f4f5c (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=ad080cebfaf843d28992272bb40f60d0]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:30.600 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.595741 19183 tablet_service.cc:764] Processing CreateTablet for tablet c44211462fbc43959f0265b9662f4f5c (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=ad080cebfaf843d28992272bb40f60d0]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:30.602 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.602066 19183 ts_tablet_manager.cc:948] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Registered tablet (data state: TABLET_DATA_READY) 03:46:30.602 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.602854 20129 ts_tablet_manager.cc:798] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrapping tablet 03:46:30.604 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.604776 20129 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrap starting. 03:46:30.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.607656 20129 tablet_bootstrap.cc:568] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: No blocks or log segments found. Creating new log. 03:46:30.608 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.608719 20129 log.cc:518] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Log is configured to *not* fsync() on all Append() calls 03:46:30.610 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.610124 20129 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: No bootstrap required, opened a new log 03:46:30.610 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.610574 20129 ts_tablet_manager.cc:823] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s 03:46:30.612 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@75a3d5f5@1973671413 returned Deferred@297436284(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@2351dbab -> (continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$1@75a3d5f5@1973671413), errback=passthrough -> (continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$1@75a3d5f5@1973671413)), so the following Deferred is getting paused: Deferred@1920815962(state=PAUSED, result=Deferred@297436284, callback=org.apache.kudu.client.AsyncKuduClient$2@a998b1f -> wakeup thread main, errback=passthrough -> wakeup thread main) 03:46:30.612 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.612144 20129 raft_consensus.cc:287] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:30.612 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.612351 20129 raft_consensus.cc:313] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:30.612 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.612658 20129 raft_consensus.cc:576] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f9940e383340d9b9cf3adbabf5612d, State: Initialized, Role: FOLLOWER 03:46:30.612 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.612927 20129 consensus_queue.cc:190] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:30.616 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.613765 19443 tablet_service.cc:764] Processing CreateTablet for tablet c44211462fbc43959f0265b9662f4f5c (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=ad080cebfaf843d28992272bb40f60d0]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:30.617 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.617139 20129 ts_tablet_manager.cc:851] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s 03:46:30.619 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.619057 19443 ts_tablet_manager.cc:948] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Registered tablet (data state: TABLET_DATA_READY) 03:46:30.619 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.619684 20132 ts_tablet_manager.cc:798] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Bootstrapping tablet 03:46:30.620 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.620112 20132 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Bootstrap starting. 03:46:30.622 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.622200 20132 tablet_bootstrap.cc:568] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: No blocks or log segments found. Creating new log. 03:46:30.623 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.623221 20132 log.cc:518] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Log is configured to *not* fsync() on all Append() calls 03:46:30.624 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.624606 20132 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: No bootstrap required, opened a new log 03:46:30.625 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.625035 20132 ts_tablet_manager.cc:823] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s 03:46:30.626 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:571) Opened table ad080cebfaf843d28992272bb40f60d0 03:46:30.626 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.626802 20132 raft_consensus.cc:287] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:30.627 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.627094 20132 raft_consensus.cc:313] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:30.627 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.627766 20132 raft_consensus.cc:576] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6712fb9e95d482d881d3f8c58936d42, State: Initialized, Role: FOLLOWER 03:46:30.627 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783)), so the following Deferred is getting paused: Deferred@1920815962(state=PAUSED, result=Deferred@180226612, callback=wakeup thread main, errback=wakeup thread main) 03:46:30.628 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.628098 20132 consensus_queue.cc:190] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:30.632 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.632249 20132 ts_tablet_manager.cc:851] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Time spent starting tablet: real 0.007s user 0.000s sys 0.000s 03:46:30.643 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139)), so the following Deferred is getting paused: Deferred@1814609494(state=PAUSED, result=Deferred@180226612, callback=, errback=) 03:46:30.655 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725)), so the following Deferred is getting paused: Deferred@1316035199(state=PAUSED, result=Deferred@180226612, callback=, errback=) 03:46:30.665 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.665213 18978 ts_tablet_manager.cc:948] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Registered tablet (data state: TABLET_DATA_READY) 03:46:30.674 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718)), so the following Deferred is getting paused: Deferred@954250444(state=PAUSED, result=Deferred@180226612, callback=, errback=) 03:46:30.675 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.675395 20135 ts_tablet_manager.cc:798] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrapping tablet 03:46:30.675 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.675710 20135 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrap starting. 03:46:30.677 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.677641 20135 tablet_bootstrap.cc:568] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: No blocks or log segments found. Creating new log. 03:46:30.692 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396)), so the following Deferred is getting paused: Deferred@1757243610(state=PAUSED, result=Deferred@180226612, callback=, errback=) 03:46:30.693 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.693614 20135 log.cc:518] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Log is configured to *not* fsync() on all Append() calls 03:46:30.694 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.694838 20135 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: No bootstrap required, opened a new log 03:46:30.695 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.695073 20135 ts_tablet_manager.cc:823] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.000s 03:46:30.697 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.697010 20135 raft_consensus.cc:287] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:30.697 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.697378 20135 raft_consensus.cc:313] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:30.697 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.697855 20135 raft_consensus.cc:576] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5851213ca55407284d76a9cea74db72, State: Initialized, Role: FOLLOWER 03:46:30.698 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.698118 20135 consensus_queue.cc:190] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:30.713 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396) -> (continuation of Deferred@1598701431 after org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396) -> (continuation of Deferred@1598701431 after org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313)), so the following Deferred is getting paused: Deferred@1598701431(state=PAUSED, result=Deferred@180226612, callback=, errback=) 03:46:30.735 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@3898cc4f@949537871 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396) -> (continuation of Deferred@1598701431 after org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313) -> (continuation of Deferred@996186174 after org.apache.kudu.client.AsyncKuduClient$12@3898cc4f@949537871), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396) -> (continuation of Deferred@1598701431 after org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313) -> (continuation of Deferred@996186174 after org.apache.kudu.client.AsyncKuduClient$12@3898cc4f@949537871)), so the following Deferred is getting paused: Deferred@996186174(state=PAUSED, result=Deferred@180226612, callback=, errback=) 03:46:30.743 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.743593 20135 ts_tablet_manager.cc:851] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Time spent starting tablet: real 0.048s user 0.004s sys 0.000s 03:46:30.799 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@54375e02@1412914690 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396) -> (continuation of Deferred@1598701431 after org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313) -> (continuation of Deferred@996186174 after org.apache.kudu.client.AsyncKuduClient$12@3898cc4f@949537871) -> (continuation of Deferred@1510498932 after org.apache.kudu.client.AsyncKuduClient$12@54375e02@1412914690), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396) -> (continuation of Deferred@1598701431 after org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313) -> (continuation of Deferred@996186174 after org.apache.kudu.client.AsyncKuduClient$12@3898cc4f@949537871) -> (continuation of Deferred@1510498932 after org.apache.kudu.client.AsyncKuduClient$12@54375e02@1412914690)), so the following Deferred is getting paused: Deferred@1510498932(state=PAUSED, result=Deferred@180226612, callback=, errback=) 03:46:30.849 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.847929 20140 raft_consensus.cc:412] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:30.849 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.848037 20140 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.785s (starting election) 03:46:30.849 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.848161 20140 raft_consensus.cc:434] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:30.849 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.849156 20140 leader_election.cc:221] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer f6712fb9e95d482d881d3f8c58936d42 03:46:30.850 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.849434 20140 leader_election.cc:221] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer a3f9940e383340d9b9cf3adbabf5612d 03:46:30.855 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@248c37ce@613169102 returned Deferred@180226612(state=PENDING, result=null, callback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396) -> (continuation of Deferred@1598701431 after org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313) -> (continuation of Deferred@996186174 after org.apache.kudu.client.AsyncKuduClient$12@3898cc4f@949537871) -> (continuation of Deferred@1510498932 after org.apache.kudu.client.AsyncKuduClient$12@54375e02@1412914690) -> (continuation of Deferred@462613001 after org.apache.kudu.client.AsyncKuduClient$12@248c37ce@613169102), errback=(continuation of Deferred@1920815962 after org.apache.kudu.client.AsyncKuduClient$2@a998b1f@177834783) -> (continuation of Deferred@1814609494 after org.apache.kudu.client.AsyncKuduClient$12@271f044b@656344139) -> (continuation of Deferred@1316035199 after org.apache.kudu.client.AsyncKuduClient$12@3464596d@878991725) -> (continuation of Deferred@954250444 after org.apache.kudu.client.AsyncKuduClient$12@119362a6@294871718) -> (continuation of Deferred@1757243610 after org.apache.kudu.client.AsyncKuduClient$12@2e593d8c@777600396) -> (continuation of Deferred@1598701431 after org.apache.kudu.client.AsyncKuduClient$12@62b1a139@1655808313) -> (continuation of Deferred@996186174 after org.apache.kudu.client.AsyncKuduClient$12@3898cc4f@949537871) -> (continuation of Deferred@1510498932 after org.apache.kudu.client.AsyncKuduClient$12@54375e02@1412914690) -> (continuation of Deferred@462613001 after org.apache.kudu.client.AsyncKuduClient$12@248c37ce@613169102)), so the following Deferred is getting paused: Deferred@462613001(state=PAUSED, result=Deferred@180226612, callback=, errback=) 03:46:30.895 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.895297 19203 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "c44211462fbc43959f0265b9662f4f5c" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f9940e383340d9b9cf3adbabf5612d" is_pre_election: true 03:46:30.896 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.895506 19203 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Snoozing failure detection for 2.157s (vote granted) 03:46:30.896 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.895573 19203 raft_consensus.cc:2010] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5851213ca55407284d76a9cea74db72 in term 0. 03:46:30.895 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.895277 19472 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "c44211462fbc43959f0265b9662f4f5c" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6712fb9e95d482d881d3f8c58936d42" is_pre_election: true 03:46:30.897 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.895508 19472 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Snoozing failure detection for 1.591s (vote granted) 03:46:30.897 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.895573 19472 raft_consensus.cc:2010] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5851213ca55407284d76a9cea74db72 in term 0. 03:46:30.897 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.896366 18891 leader_election.cc:353] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Vote granted by peer f6712fb9e95d482d881d3f8c58936d42 03:46:30.897 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.896445 18891 leader_election.cc:248] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:30.897 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.896807 20140 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.640s (election complete) 03:46:30.897 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.896854 20140 raft_consensus.cc:2280] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:30.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.896878 20140 raft_consensus.cc:412] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:30.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.896890 20140 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 2.203s (starting election) 03:46:30.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.896903 20140 raft_consensus.cc:2508] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Advancing to term 1 03:46:30.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.897958 20140 raft_consensus.cc:434] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:30.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.898275 20140 leader_election.cc:221] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 election: Requesting vote from peer f6712fb9e95d482d881d3f8c58936d42 03:46:30.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.898388 20140 leader_election.cc:221] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 election: Requesting vote from peer a3f9940e383340d9b9cf3adbabf5612d 03:46:30.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.898650 18887 leader_election.cc:353] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Vote granted by peer a3f9940e383340d9b9cf3adbabf5612d 03:46:30.900 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.899078 19472 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "c44211462fbc43959f0265b9662f4f5c" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6712fb9e95d482d881d3f8c58936d42" 03:46:30.901 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.899153 19472 raft_consensus.cc:2508] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Advancing to term 1 03:46:30.901 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.899240 19472 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Snoozing failure detection for 1.933s (vote granted) 03:46:30.901 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.899365 19203 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "c44211462fbc43959f0265b9662f4f5c" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f9940e383340d9b9cf3adbabf5612d" 03:46:30.901 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.900735 18887 leader_election.cc:353] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 election: Vote granted by peer a3f9940e383340d9b9cf3adbabf5612d 03:46:30.901 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.899435 19203 raft_consensus.cc:2508] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Advancing to term 1 03:46:30.901 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.899518 19203 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Snoozing failure detection for 1.709s (vote granted) 03:46:30.901 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:30.900117 19472 raft_consensus.cc:2010] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5851213ca55407284d76a9cea74db72 in term 1. 03:46:30.901 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:30.900379 19203 raft_consensus.cc:2010] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5851213ca55407284d76a9cea74db72 in term 1. 03:46:30.901 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.900766 18887 leader_election.cc:248] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:30.901 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.900884 20140 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.614s (election complete) 03:46:30.902 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.900910 20140 raft_consensus.cc:2280] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Leader election won for term 1 03:46:30.902 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.901594 18891 leader_election.cc:353] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 election: Vote granted by peer f6712fb9e95d482d881d3f8c58936d42 03:46:30.932 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.928675 20140 raft_consensus.cc:542] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 LEADER]: Becoming Leader. State: Replica: b5851213ca55407284d76a9cea74db72, State: Running, Role: LEADER 03:46:30.932 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:30.929005 20140 consensus_queue.cc:169] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:30.938 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:30.937963 18790 catalog_manager.cc:2511] T c44211462fbc43959f0265b9662f4f5c reported cstate change: term changed from 0 to 1, leader changed from to b5851213ca55407284d76a9cea74db72 (127.70.237.1). New cstate: current_term: 1 leader_uuid: "b5851213ca55407284d76a9cea74db72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } 03:46:31.148 [DEBUG - main] (AsyncKuduClient.java:1287) Cannot continue with RPC because of: Timed out: can not complete before timeout: KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=1, elapsed=3), No traces, null) 03:46:31.162 [DEBUG - main] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@510109769(state=PENDING, result=null, callback=, errback=)} 03:46:31.163 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet c44211462fbc43959f0265b9662f4f5c for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:31.165 [DEBUG - main] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@57d5872c@1473611564 returned Deferred@107456312(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@921760190 after org.apache.kudu.client.AsyncKuduSession$1@57d5872c@1473611564), errback=passthrough -> (continuation of Deferred@921760190 after org.apache.kudu.client.AsyncKuduSession$1@57d5872c@1473611564)), so the following Deferred is getting paused: Deferred@921760190(state=PAUSED, result=Deferred@107456312, callback=, errback=) 03:46:31.175 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=c44211462fbc43959f0265b9662f4f5c, ttl=299989}] 03:46:31.211 [ERROR - New I/O boss #130] (Connection.java:436) [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0x1efd4b31] java.net.ConnectException: Connection refused: /127.70.237.1:64036 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 03:46:31.225 [DEBUG - New I/O worker #70] (Connection.java:666) [peer b5851213ca55407284d76a9cea74db72] cleaning up while in state CONNECTING due to: connection closed 03:46:31.227 [INFO - New I/O worker #70] (AsyncKuduClient.java:1582) Removing server b5851213ca55407284d76a9cea74db72 from this tablet's cache c44211462fbc43959f0265b9662f4f5c 03:46:31.229 [DEBUG - New I/O worker #70] (AsyncKuduClient.java:1287) Cannot continue with RPC because of: Timed out: can not complete before timeout: Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=c44211462fbc43959f0265b9662f4f5c, attempt=1, DeadlineTracker(timeout=1, elapsed=50), Traces: [0ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [47ms] received from server b5851213ca55407284d76a9cea74db72 response Network error: connection closed, [49ms] delaying RPC due to Network error: connection closed, Deferred@655442227(state=PENDING, result=null, callback=apply batch response, errback=apply batch error response))} 03:46:31.389 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:31.389 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:31.389363 20188 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:31.390 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:31.390463 20188 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:31.390 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:31.390502 20188 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:31.390 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:31.390524 20188 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.392145 20188 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64036 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 03:46:31.392 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:31.393 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.20188 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/logs 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:31.394 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:31.395 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type DEBUG 03:46:31.395 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:31.395 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 9998 03:46:31.410 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.410305 20188 minidump.cc:237] Setting minidump size limit to 20M 03:46:31.481 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.480962 20188 tablet_server_main.cc:79] Initializing tablet server... 03:46:31.481 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.481823 20188 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 439829 03:46:31.521 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.521646 20188 fs_manager.cc:323] Time spent opening directory manager: real 0.027s user 0.000s sys 0.004s 03:46:31.522 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.521878 20188 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:31.522 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.522092 20188 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:31.533 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.533762 20188 fs_manager.cc:335] Time spent opening block manager: real 0.009s user 0.004s sys 0.000s 03:46:31.534 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.534569 20188 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:31.534 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "b5851213ca55407284d76a9cea74db72" 03:46:31.534 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:26 on jenkins-slave-c3oe" 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.534677 20188 fs_report.cc:347] Block manager report 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data/data 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:31.535 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:31.536 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:31.536 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:31.536 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:31.645 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.645419 20188 ts_tablet_manager.cc:204] Loading tablet metadata (0/1 complete) 03:46:31.645 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.645464 20188 ts_tablet_manager.cc:775] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Loading tablet metadata 03:46:31.648 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.648672 20188 ts_tablet_manager.cc:216] Loaded tablet metadata (1 live tablets) 03:46:31.650 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.650269 20188 ts_tablet_manager.cc:948] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Registered tablet (data state: TABLET_DATA_READY) 03:46:31.664 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.664860 20216 ts_tablet_manager.cc:798] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrapping tablet 03:46:31.665 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.665240 20216 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrap starting. 03:46:31.670 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.670143 20216 log.cc:518] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Log is configured to *not* fsync() on all Append() calls 03:46:31.676 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.676523 20188 tablet_server_main.cc:84] Starting tablet server... 03:46:31.680 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.680001 20216 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates 03:46:31.680 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.680462 20216 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrap complete. 03:46:31.680 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.680840 20216 ts_tablet_manager.cc:823] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.000s 03:46:31.683 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.683647 20216 raft_consensus.cc:287] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:31.684 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.684545 20216 raft_consensus.cc:576] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5851213ca55407284d76a9cea74db72, State: Initialized, Role: FOLLOWER 03:46:31.684 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.684701 20216 consensus_queue.cc:190] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:31.701 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:31.701767 20216 ts_tablet_manager.cc:851] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Time spent starting tablet: real 0.021s user 0.004s sys 0.000s 03:46:31.735 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:31.740 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:31.735635 20208 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:31.742 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:31.742082 20208 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:31.742 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:31.742406 20208 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:31.742 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:31.742604 20208 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:31.744 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.744598 20208 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:31.744 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:31.744 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:31.744 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:31.744 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64038 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.20208 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/logs 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type DEBUG 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:31.745 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 9998 03:46:31.814 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.814400 20208 minidump.cc:237] Setting minidump size limit to 20M 03:46:31.870 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.870178 20208 tablet_server_main.cc:79] Initializing tablet server... 03:46:31.871 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.871479 20208 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 439829 03:46:31.897 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.897699 20208 fs_manager.cc:323] Time spent opening directory manager: real 0.014s user 0.004s sys 0.000s 03:46:31.898 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.898355 20208 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:31.898 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.898844 20208 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:31.913 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.913818 20208 fs_manager.cc:335] Time spent opening block manager: real 0.012s user 0.004s sys 0.000s 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.914960 20208 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "a3f9940e383340d9b9cf3adbabf5612d" 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:27 on jenkins-slave-c3oe" 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:31.915452 20208 fs_report.cc:347] Block manager report 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data/data 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:31.915 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:31.916 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:31.916 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:32.037 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.037464 20208 ts_tablet_manager.cc:204] Loading tablet metadata (0/1 complete) 03:46:32.037 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.037915 20208 ts_tablet_manager.cc:775] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Loading tablet metadata 03:46:32.041 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.041429 20208 ts_tablet_manager.cc:216] Loaded tablet metadata (1 live tablets) 03:46:32.043 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.043259 20208 ts_tablet_manager.cc:948] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Registered tablet (data state: TABLET_DATA_READY) 03:46:32.056 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.056792 20293 ts_tablet_manager.cc:798] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrapping tablet 03:46:32.057 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.057577 20293 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrap starting. 03:46:32.062 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.062798 20293 log.cc:518] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Log is configured to *not* fsync() on all Append() calls 03:46:32.065 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.065656 20208 tablet_server_main.cc:84] Starting tablet server... 03:46:32.081 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.081907 20293 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 03:46:32.082 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.082610 20293 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrap complete. 03:46:32.083 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.083189 20293 ts_tablet_manager.cc:823] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s 03:46:32.086 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.086292 20293 raft_consensus.cc:287] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:32.087 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.087183 20293 raft_consensus.cc:576] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f9940e383340d9b9cf3adbabf5612d, State: Initialized, Role: FOLLOWER 03:46:32.087 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.087572 20293 consensus_queue.cc:190] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:32.101 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.100966 20293 ts_tablet_manager.cc:851] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s 03:46:32.289 [INFO - Time-limited test] (BaseKuduTest.java:131) Creating table: non-replicated 03:46:32.296 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.295243 18790 catalog_manager.cc:1211] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:41428: 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "non-replicated" 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) schema { 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: true 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column1_i" 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:32.297 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column2_i" 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column3_s" 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: STRING 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: true 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) compression: LZ4 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 4096 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:32.298 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column4_b" 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: BOOL 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) num_replicas: 1 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) partition_schema { 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) range_schema { 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.299 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:32.351 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@26312f74@640757620 returned Deferred@1786844702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@26f2b15b -> (continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$1@26312f74@640757620), errback=passthrough -> (continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$1@26312f74@640757620)), so the following Deferred is getting paused: Deferred@1867376516(state=PAUSED, result=Deferred@1786844702, callback=org.apache.kudu.client.AsyncKuduClient$2@40a82f96 -> wakeup thread Time-limited test, errback=passthrough -> wakeup thread Time-limited test) 03:46:32.353 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:571) Opened table 76b508c390a54f5bbdc58c20e8c51073 03:46:32.354 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054 returned Deferred@586932347(state=PENDING, result=null, callback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054), errback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054)), so the following Deferred is getting paused: Deferred@1867376516(state=PAUSED, result=Deferred@586932347, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 03:46:32.355 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.355686 20208 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64038 03:46:32.357 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.356284 20208 webserver.cc:149] Starting webserver on 127.70.237.1:64039 03:46:32.357 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.356304 20208 webserver.cc:160] Document root disabled 03:46:32.357 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.356814 20208 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64039/ 03:46:32.362 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:32.362159 18718 catalog_manager.cc:2847] TS b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036): Create Tablet RPC failed for tablet a940445cf22c41d2af967fed9d07c856: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64036: connect: Connection refused (error 111) 03:46:32.363 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.362200 18718 catalog_manager.cc:2883] Scheduling retry of CreateTablet RPC for tablet a940445cf22c41d2af967fed9d07c856 on TS b5851213ca55407284d76a9cea74db72 with a delay of 43 ms (attempt = 1) 03:46:32.369 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.369470 20208 tablet_server_main.cc:87] Tablet server successfully started. 03:46:32.370 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.370132 20471 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:32.370 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.370831 20471 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:32.371 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.371032 20471 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:32.383 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046 returned Deferred@586932347(state=PENDING, result=null, callback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046), errback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046)), so the following Deferred is getting paused: Deferred@289493363(state=PAUSED, result=Deferred@586932347, callback=, errback=) 03:46:32.393 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402 returned Deferred@586932347(state=PENDING, result=null, callback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402), errback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402)), so the following Deferred is getting paused: Deferred@1838270995(state=PAUSED, result=Deferred@586932347, callback=, errback=) 03:46:32.406 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:32.406450 18718 catalog_manager.cc:2847] TS b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036): Create Tablet RPC failed for tablet a940445cf22c41d2af967fed9d07c856: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64036: connect: Connection refused (error 111) 03:46:32.407 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.406489 18718 catalog_manager.cc:2883] Scheduling retry of CreateTablet RPC for tablet a940445cf22c41d2af967fed9d07c856 on TS b5851213ca55407284d76a9cea74db72 with a delay of 74 ms (attempt = 2) 03:46:32.415 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834 returned Deferred@586932347(state=PENDING, result=null, callback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834), errback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834)), so the following Deferred is getting paused: Deferred@1624151611(state=PAUSED, result=Deferred@586932347, callback=, errback=) 03:46:32.420 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.419378 20465 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:32.420 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.419544 20465 heartbeater.cc:387] Registering TS with master... 03:46:32.420 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.419932 20465 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:32.420 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.419992 20470 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:32.420 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.420032 20470 heartbeater.cc:387] Registering TS with master... 03:46:32.420 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.420155 20470 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:32.421 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.419378 20469 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:32.421 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.421133 20469 heartbeater.cc:387] Registering TS with master... 03:46:32.421 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:32.421264 20469 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:32.422 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:32.422066 18645 ts_manager.cc:87] Re-registered known tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:32.422 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:32.422428 18472 ts_manager.cc:87] Re-registered known tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:32.422 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.421141 18790 ts_manager.cc:87] Re-registered known tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:32.425 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.422143 18790 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:58985 03:46:32.436 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144 returned Deferred@586932347(state=PENDING, result=null, callback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834) -> (continuation of Deferred@864705980 after org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144), errback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834) -> (continuation of Deferred@864705980 after org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144)), so the following Deferred is getting paused: Deferred@864705980(state=PAUSED, result=Deferred@586932347, callback=, errback=) 03:46:32.458 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@34c519a5@885332389 returned Deferred@586932347(state=PENDING, result=null, callback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834) -> (continuation of Deferred@864705980 after org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144) -> (continuation of Deferred@548290120 after org.apache.kudu.client.AsyncKuduClient$12@34c519a5@885332389), errback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834) -> (continuation of Deferred@864705980 after org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144) -> (continuation of Deferred@548290120 after org.apache.kudu.client.AsyncKuduClient$12@34c519a5@885332389)), so the following Deferred is getting paused: Deferred@548290120(state=PAUSED, result=Deferred@586932347, callback=, errback=) 03:46:32.485 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:32.485054 18718 catalog_manager.cc:2847] TS b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036): Create Tablet RPC failed for tablet a940445cf22c41d2af967fed9d07c856: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64036: connect: Connection refused (error 111) 03:46:32.486 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.485098 18718 catalog_manager.cc:2883] Scheduling retry of CreateTablet RPC for tablet a940445cf22c41d2af967fed9d07c856 on TS b5851213ca55407284d76a9cea74db72 with a delay of 97 ms (attempt = 3) 03:46:32.495 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@36b721a1@917971361 returned Deferred@586932347(state=PENDING, result=null, callback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834) -> (continuation of Deferred@864705980 after org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144) -> (continuation of Deferred@548290120 after org.apache.kudu.client.AsyncKuduClient$12@34c519a5@885332389) -> (continuation of Deferred@1471278454 after org.apache.kudu.client.AsyncKuduClient$12@36b721a1@917971361), errback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834) -> (continuation of Deferred@864705980 after org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144) -> (continuation of Deferred@548290120 after org.apache.kudu.client.AsyncKuduClient$12@34c519a5@885332389) -> (continuation of Deferred@1471278454 after org.apache.kudu.client.AsyncKuduClient$12@36b721a1@917971361)), so the following Deferred is getting paused: Deferred@1471278454(state=PAUSED, result=Deferred@586932347, callback=, errback=) 03:46:32.522 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:32.523 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:32.522591 20262 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:32.525 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:32.525137 20262 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:32.534 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@4b25ce14@1260768788 returned Deferred@586932347(state=PENDING, result=null, callback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834) -> (continuation of Deferred@864705980 after org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144) -> (continuation of Deferred@548290120 after org.apache.kudu.client.AsyncKuduClient$12@34c519a5@885332389) -> (continuation of Deferred@1471278454 after org.apache.kudu.client.AsyncKuduClient$12@36b721a1@917971361) -> (continuation of Deferred@447276358 after org.apache.kudu.client.AsyncKuduClient$12@4b25ce14@1260768788), errback=(continuation of Deferred@1867376516 after org.apache.kudu.client.AsyncKuduClient$2@40a82f96@1084764054) -> (continuation of Deferred@289493363 after org.apache.kudu.client.AsyncKuduClient$12@1130e516@288417046) -> (continuation of Deferred@1838270995 after org.apache.kudu.client.AsyncKuduClient$12@10141852@269752402) -> (continuation of Deferred@1624151611 after org.apache.kudu.client.AsyncKuduClient$12@7b1f9ae2@2065668834) -> (continuation of Deferred@864705980 after org.apache.kudu.client.AsyncKuduClient$12@5028c4f8@1344849144) -> (continuation of Deferred@548290120 after org.apache.kudu.client.AsyncKuduClient$12@34c519a5@885332389) -> (continuation of Deferred@1471278454 after org.apache.kudu.client.AsyncKuduClient$12@36b721a1@917971361) -> (continuation of Deferred@447276358 after org.apache.kudu.client.AsyncKuduClient$12@4b25ce14@1260768788)), so the following Deferred is getting paused: Deferred@447276358(state=PAUSED, result=Deferred@586932347, callback=, errback=) 03:46:32.538 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.538306 20188 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64036 03:46:32.539 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.538986 20188 webserver.cc:149] Starting webserver on 127.70.237.1:64037 03:46:32.539 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.539193 20188 webserver.cc:160] Document root disabled 03:46:32.539 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.539815 20188 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64037/ 03:46:32.542 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.542920 20188 tablet_server_main.cc:87] Tablet server successfully started. 03:46:32.543 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:32.543251 20262 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:32.544 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.543582 20553 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:32.544 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.543607 20553 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:32.544 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.543624 20553 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:32.544 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:32.543366 20262 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:32.569 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.569883 20262 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64040 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.20262 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:32.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:32.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/logs 03:46:32.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 03:46:32.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 03:46:32.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:32.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:32.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type DEBUG 03:46:32.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:32.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 9998 03:46:32.582 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.582233 20262 minidump.cc:237] Setting minidump size limit to 20M 03:46:32.586 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.586321 20550 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:32.586 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.586323 20552 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:32.586 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.586479 20550 heartbeater.cc:387] Registering TS with master... 03:46:32.586 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.586480 20552 heartbeater.cc:387] Registering TS with master... 03:46:32.586 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.586777 20550 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:32.586 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.586777 20552 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:32.587 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.587430 20549 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:32.587 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.587471 20549 heartbeater.cc:387] Registering TS with master... 03:46:32.587 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.587635 18790 ts_manager.cc:87] Re-registered known tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:32.587 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.587575 20549 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:32.587 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:32.587735 18645 ts_manager.cc:87] Re-registered known tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:32.588 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:32.588160 18472 ts_manager.cc:87] Re-registered known tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:32.588 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.588292 18790 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:58653 03:46:32.597 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.597626 20339 tablet_service.cc:764] Processing CreateTablet for tablet a940445cf22c41d2af967fed9d07c856 (table=non-replicated [id=76b508c390a54f5bbdc58c20e8c51073]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:32.600 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.600371 20339 ts_tablet_manager.cc:948] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Registered tablet (data state: TABLET_DATA_READY) 03:46:32.600 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.600836 20573 ts_tablet_manager.cc:798] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Bootstrapping tablet 03:46:32.601 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.600942 20573 tablet_bootstrap.cc:433] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Bootstrap starting. 03:46:32.601 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.601810 20573 tablet_bootstrap.cc:568] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: No blocks or log segments found. Creating new log. 03:46:32.614 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.613943 20573 tablet_bootstrap.cc:433] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: No bootstrap required, opened a new log 03:46:32.614 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.614075 20573 ts_tablet_manager.cc:823] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.000s 03:46:32.614 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.614725 20573 raft_consensus.cc:287] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:32.614 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.614760 20573 raft_consensus.cc:313] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:32.615 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.614928 20573 raft_consensus.cc:576] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5851213ca55407284d76a9cea74db72, State: Initialized, Role: FOLLOWER 03:46:32.615 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.614971 20573 consensus_queue.cc:190] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:32.615 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.614996 20573 raft_consensus.cc:328] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately 03:46:32.615 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.615031 20573 raft_consensus.cc:412] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) 03:46:32.615 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.615092 20573 raft_consensus.cc:2456] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 2.132s (starting election) 03:46:32.615 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.615113 20573 raft_consensus.cc:2508] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Advancing to term 1 03:46:32.619 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.619899 20573 raft_consensus.cc:434] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:32.620 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.620386 20573 leader_election.cc:248] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:32.637 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.637332 20262 tablet_server_main.cc:79] Initializing tablet server... 03:46:32.637 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.637923 20262 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 440329 03:46:32.642 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.642284 20573 ts_tablet_manager.cc:851] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Time spent starting tablet: real 0.028s user 0.008s sys 0.004s 03:46:32.642 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.642856 20552 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:32.643 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.643105 20578 raft_consensus.cc:2456] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.623s (election complete) 03:46:32.643 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.643153 20578 raft_consensus.cc:2280] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Leader election won for term 1 03:46:32.643 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.643255 20578 raft_consensus.cc:542] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 1 LEADER]: Becoming Leader. State: Replica: b5851213ca55407284d76a9cea74db72, State: Running, Role: LEADER 03:46:32.643 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:32.643467 20578 consensus_queue.cc:169] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:32.646 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:32.646884 18790 catalog_manager.cc:2511] T a940445cf22c41d2af967fed9d07c856 reported cstate change: term changed from 0 to 1, leader changed from to b5851213ca55407284d76a9cea74db72 (127.70.237.1). New cstate: current_term: 1 leader_uuid: "b5851213ca55407284d76a9cea74db72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } } 03:46:32.663 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.663522 20262 fs_manager.cc:323] Time spent opening directory manager: real 0.012s user 0.004s sys 0.000s 03:46:32.664 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.663686 20262 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:32.664 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.663833 20262 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:32.677 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet a940445cf22c41d2af967fed9d07c856 for table 'non-replicated' with partition [, ) 03:46:32.678 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=a940445cf22c41d2af967fed9d07c856, ttl=299999}] 03:46:32.678 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, DeadlineTracker(timeout=30000, elapsed=4), Traces: [0ms] querying master, [1ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response OK, null) after lookup 03:46:32.681 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1302327315 returned Deferred@682611418(state=PENDING, result=null, callback=(continuation of Deferred@1978699868 after retry RPC@1302327315), errback=(continuation of Deferred@1978699868 after retry RPC@1302327315)), so the following Deferred is getting paused: Deferred@1978699868(state=PAUSED, result=Deferred@682611418, callback=passthrough -> wakeup thread Time-limited test, errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@bbf12c4 -> wakeup thread Time-limited test) 03:46:32.701 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.701622 20262 fs_manager.cc:335] Time spent opening block manager: real 0.036s user 0.000s sys 0.004s 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.702672 20262 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "f6712fb9e95d482d881d3f8c58936d42" 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:27 on jenkins-slave-c3oe" 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:32.702780 20262 fs_report.cc:347] Block manager report 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data/data 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:32.703 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:32.704 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:32.789 [DEBUG - New I/O worker #71] (Connection.java:666) [peer b5851213ca55407284d76a9cea74db72] cleaning up while in state READY due to: connection disconnected 03:46:32.791 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) *** Aborted at 1505706392 (unix time) try "date -d @1505706392" if you are using GNU date *** 03:46:32.820 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) *** Aborted at 1505706392 (unix time) try "date -d @1505706392" if you are using GNU date *** 03:46:32.820 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) PC: @ 0x7f53c5320137 (unknown) 03:46:32.820 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) *** SIGTERM (@0x3e8000046ed) received by PID 20262 (TID 0x7f53cedef880) from PID 18157; stack trace: *** 03:46:32.820 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7f53cc597cb0 (unknown) 03:46:32.820 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7f53c5320137 (unknown) 03:46:33.084 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:33.084 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:33.060374 20607 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:33.086 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:33.086513 20607 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:33.096 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:33.096545 20607 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:33.097 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:33.096985 20607 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:33.100 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.100774 20607 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:33.100 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64036 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.20607 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/logs 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:33.101 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type DEBUG 03:46:33.102 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:33.102 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 9998 03:46:33.133 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.133571 20607 minidump.cc:237] Setting minidump size limit to 20M 03:46:33.156 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.156857 20607 tablet_server_main.cc:79] Initializing tablet server... 03:46:33.158 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.158033 20607 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 440829 03:46:33.209 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.209508 20607 fs_manager.cc:323] Time spent opening directory manager: real 0.020s user 0.004s sys 0.000s 03:46:33.209 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.209717 20607 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:33.209 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.209919 20607 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:33.228 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.221694 20607 fs_manager.cc:335] Time spent opening block manager: real 0.010s user 0.004s sys 0.000s 03:46:33.228 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.222414 20607 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data 03:46:33.228 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "b5851213ca55407284d76a9cea74db72" 03:46:33.228 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:26 on jenkins-slave-c3oe" 03:46:33.228 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.222503 20607 fs_report.cc:347] Block manager report 03:46:33.228 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 03:46:33.228 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data/data 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:33.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:33.284 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:33.284 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:33.283905 20631 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:33.285 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:33.285529 20631 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:33.285 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:33.285751 20631 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:33.285 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:33.285893 20631 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:33.287 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.287722 20631 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:33.287 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:33.287 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:33.287 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64038 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.20631 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/logs 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type DEBUG 03:46:33.288 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:33.289 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 9998 03:46:33.315 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.315265 20631 minidump.cc:237] Setting minidump size limit to 20M 03:46:33.349 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.348646 20631 tablet_server_main.cc:79] Initializing tablet server... 03:46:33.349 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.349508 20631 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 440829 03:46:33.363 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.357498 20607 ts_tablet_manager.cc:204] Loading tablet metadata (0/2 complete) 03:46:33.363 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.357535 20607 ts_tablet_manager.cc:775] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Loading tablet metadata 03:46:33.363 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.360723 20607 ts_tablet_manager.cc:775] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Loading tablet metadata 03:46:33.363 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.361451 20607 ts_tablet_manager.cc:216] Loaded tablet metadata (2 live tablets) 03:46:33.363 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.362956 20607 ts_tablet_manager.cc:948] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Registered tablet (data state: TABLET_DATA_READY) 03:46:33.373 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.373250 20607 ts_tablet_manager.cc:948] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Registered tablet (data state: TABLET_DATA_READY) 03:46:33.374 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.373977 20692 ts_tablet_manager.cc:798] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Bootstrapping tablet 03:46:33.375 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.375054 20692 tablet_bootstrap.cc:433] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Bootstrap starting. 03:46:33.385 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.384516 20607 tablet_server_main.cc:84] Starting tablet server... 03:46:33.390 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.390501 20631 fs_manager.cc:323] Time spent opening directory manager: real 0.019s user 0.000s sys 0.000s 03:46:33.391 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.391067 20631 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:33.391 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.391422 20631 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:33.409 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.409024 20692 log.cc:518] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Log is configured to *not* fsync() on all Append() calls 03:46:33.413 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.413842 20631 fs_manager.cc:335] Time spent opening block manager: real 0.020s user 0.000s sys 0.004s 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.414973 20631 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "a3f9940e383340d9b9cf3adbabf5612d" 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:27 on jenkins-slave-c3oe" 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.415462 20631 fs_report.cc:347] Block manager report 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data/data 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:33.415 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:33.416 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:33.416 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:33.416 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:33.416 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:33.434 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.434460 20692 tablet_bootstrap.cc:433] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 03:46:33.434 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.434820 20692 tablet_bootstrap.cc:433] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Bootstrap complete. 03:46:33.435 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.435256 20692 ts_tablet_manager.cc:823] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Time spent bootstrapping tablet: real 0.061s user 0.012s sys 0.000s 03:46:33.437 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.437191 20692 raft_consensus.cc:287] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:33.437 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.437506 20692 raft_consensus.cc:576] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5851213ca55407284d76a9cea74db72, State: Initialized, Role: FOLLOWER 03:46:33.437 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.437741 20692 consensus_queue.cc:190] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:33.437 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.437813 20692 raft_consensus.cc:328] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately 03:46:33.437 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.437846 20692 raft_consensus.cc:412] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) 03:46:33.437 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.437916 20692 raft_consensus.cc:2456] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.543s (starting election) 03:46:33.438 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.437940 20692 raft_consensus.cc:2508] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Advancing to term 2 03:46:33.439 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.439934 20692 raft_consensus.cc:434] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:33.440 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.440312 20692 leader_election.cc:248] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. 03:46:33.460 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.460693 20711 raft_consensus.cc:2456] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.748s (election complete) 03:46:33.461 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.461091 20711 raft_consensus.cc:2280] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 2 FOLLOWER]: Leader election won for term 2 03:46:33.485 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.485349 20692 ts_tablet_manager.cc:851] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Time spent starting tablet: real 0.050s user 0.012s sys 0.000s 03:46:33.485 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.485518 20692 ts_tablet_manager.cc:798] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrapping tablet 03:46:33.485 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.485635 20692 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrap starting. 03:46:33.503 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.500674 20711 raft_consensus.cc:542] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 2 LEADER]: Becoming Leader. State: Replica: b5851213ca55407284d76a9cea74db72, State: Running, Role: LEADER 03:46:33.503 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.500962 20711 consensus_queue.cc:169] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:33.504 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.504371 20692 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates 03:46:33.505 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.505138 20692 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Bootstrap complete. 03:46:33.505 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.505317 20692 ts_tablet_manager.cc:823] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.000s 03:46:33.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.506003 20692 raft_consensus.cc:287] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:33.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.506377 20692 raft_consensus.cc:576] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5851213ca55407284d76a9cea74db72, State: Initialized, Role: FOLLOWER 03:46:33.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.506445 20692 consensus_queue.cc:190] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:33.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.506709 20692 ts_tablet_manager.cc:851] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s 03:46:33.581 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.581450 20631 ts_tablet_manager.cc:204] Loading tablet metadata (0/1 complete) 03:46:33.582 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.582614 20631 ts_tablet_manager.cc:775] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Loading tablet metadata 03:46:33.586 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.586309 20631 ts_tablet_manager.cc:216] Loaded tablet metadata (1 live tablets) 03:46:33.588 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.588186 20631 ts_tablet_manager.cc:948] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Registered tablet (data state: TABLET_DATA_READY) 03:46:33.608 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.608861 20750 ts_tablet_manager.cc:798] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrapping tablet 03:46:33.609 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.609860 20750 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrap starting. 03:46:33.612 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:33.624 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:33.611909 20726 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:33.626 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:33.626190 20726 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:33.626 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:33.626518 20726 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:33.626 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:33.626724 20726 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:33.628 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.628724 20726 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:33.628 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:33.628 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.628789 20631 tablet_server_main.cc:84] Starting tablet server... 03:46:33.628 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:33.634 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:33.634 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:33.634 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64040 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.20726 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/logs 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type DEBUG 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:33.635 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 9998 03:46:33.653 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.653694 20750 log.cc:518] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Log is configured to *not* fsync() on all Append() calls 03:46:33.654 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.654263 20726 minidump.cc:237] Setting minidump size limit to 20M 03:46:33.695 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.695168 20750 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 03:46:33.700 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.697885 20750 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Bootstrap complete. 03:46:33.700 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.698256 20750 ts_tablet_manager.cc:823] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Time spent bootstrapping tablet: real 0.089s user 0.008s sys 0.000s 03:46:33.701 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.701552 20750 raft_consensus.cc:287] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:33.701 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.700649 20726 tablet_server_main.cc:79] Initializing tablet server... 03:46:33.701 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.701385 20726 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 440829 03:46:33.702 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.702868 20750 raft_consensus.cc:576] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f9940e383340d9b9cf3adbabf5612d, State: Initialized, Role: FOLLOWER 03:46:33.705 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.704975 20750 consensus_queue.cc:190] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:33.721 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.721052 20750 ts_tablet_manager.cc:851] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Time spent starting tablet: real 0.023s user 0.004s sys 0.000s 03:46:33.744 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.742095 20726 fs_manager.cc:323] Time spent opening directory manager: real 0.012s user 0.004s sys 0.000s 03:46:33.744 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.742322 20726 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:33.744 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.742523 20726 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:33.758 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.758412 20726 fs_manager.cc:335] Time spent opening block manager: real 0.013s user 0.000s sys 0.000s 03:46:33.759 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.759567 20726 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data 03:46:33.759 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "f6712fb9e95d482d881d3f8c58936d42" 03:46:33.759 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:27 on jenkins-slave-c3oe" 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.760072 20726 fs_report.cc:347] Block manager report 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data/data 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:33.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:33.816 [DEBUG - New I/O worker #72] (Connection.java:666) [peer b5851213ca55407284d76a9cea74db72] cleaning up while in state CONNECTING due to: connection closed 03:46:33.817 [ERROR - New I/O boss #130] (Connection.java:436) [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0x6289d248] java.net.ConnectException: Connection refused: /127.70.237.1:64036 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 03:46:33.817 [INFO - New I/O worker #72] (AsyncKuduClient.java:1582) Removing server b5851213ca55407284d76a9cea74db72 from this tablet's cache a940445cf22c41d2af967fed9d07c856 03:46:33.836 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.836839 20631 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64038 03:46:33.837 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.837460 20631 webserver.cc:149] Starting webserver on 127.70.237.1:64039 03:46:33.837 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.837586 20631 webserver.cc:160] Document root disabled 03:46:33.838 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.838101 20631 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64039/ 03:46:33.851 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.850999 20631 tablet_server_main.cc:87] Tablet server successfully started. 03:46:33.851 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.850883 20964 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:33.851 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.851047 20964 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:33.851 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.851054 20964 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:33.853 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.853137 20958 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:33.856 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:33.854826 18472 ts_manager.cc:87] Re-registered known tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:33.856 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet a940445cf22c41d2af967fed9d07c856 for table 'non-replicated' with partition [, ) 03:46:33.856 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.853315 20958 heartbeater.cc:387] Registering TS with master... 03:46:33.856 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.853705 20958 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:33.856 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=a940445cf22c41d2af967fed9d07c856, ttl=299999}] 03:46:33.857 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=Write, tablet=a940445cf22c41d2af967fed9d07c856, attempt=2, DeadlineTracker(timeout=30000, elapsed=44), Traces: [0ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [4ms] received from server b5851213ca55407284d76a9cea74db72 response Network error: connection closed, [5ms] delaying RPC due to Network error: connection closed, [37ms] querying master, [37ms] Sub rpc: GetTableLocations sending RPC to server , [40ms] Sub rpc: GetTableLocations received from server response OK, Deferred@965895368(state=PENDING, result=null, callback=passthrough -> wakeup thread Time-limited test, errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6f7d5822 -> wakeup thread Time-limited test)) after lookup 03:46:33.858 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1831100360 returned Deferred@965895368(state=PENDING, result=null, callback=passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360), errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6f7d5822 -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360)), so the following Deferred is getting paused: Deferred@1195037312(state=PAUSED, result=Deferred@965895368, callback=, errback=) 03:46:33.859 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.859668 20726 ts_tablet_manager.cc:204] Loading tablet metadata (0/1 complete) 03:46:33.860 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.859719 20726 ts_tablet_manager.cc:775] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Loading tablet metadata 03:46:33.860 [ERROR - New I/O boss #130] (Connection.java:436) [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0x0011a834] java.net.ConnectException: Connection refused: /127.70.237.1:64036 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 03:46:33.861 [DEBUG - New I/O boss #130] (Connection.java:666) [peer b5851213ca55407284d76a9cea74db72] cleaning up while in state CONNECTING due to: [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0x0011a834] 03:46:33.861 [INFO - New I/O boss #130] (AsyncKuduClient.java:1582) Removing server b5851213ca55407284d76a9cea74db72 from this tablet's cache a940445cf22c41d2af967fed9d07c856 03:46:33.863 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.862963 20726 ts_tablet_manager.cc:216] Loaded tablet metadata (1 live tablets) 03:46:33.864 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.864441 20726 ts_tablet_manager.cc:948] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Registered tablet (data state: TABLET_DATA_READY) 03:46:33.865 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.865036 20972 ts_tablet_manager.cc:798] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Bootstrapping tablet 03:46:33.865 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.865336 20972 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Bootstrap starting. 03:46:33.866 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.866097 20963 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:33.866 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.866158 20963 heartbeater.cc:387] Registering TS with master... 03:46:33.866 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.866323 20963 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:33.868 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:33.867271 18790 ts_manager.cc:87] Re-registered known tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:33.868 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.868647 20726 tablet_server_main.cc:84] Starting tablet server... 03:46:33.868 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:33.868265 18790 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:46086 03:46:33.869 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.869146 20959 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:33.869 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.869191 20959 heartbeater.cc:387] Registering TS with master... 03:46:33.869 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:33.869356 20959 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:33.870 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:33.870028 18645 ts_manager.cc:87] Re-registered known tserver with Master: a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) 03:46:33.873 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet a940445cf22c41d2af967fed9d07c856 for table 'non-replicated' with partition [, ) 03:46:33.874 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=a940445cf22c41d2af967fed9d07c856, ttl=299999}] 03:46:33.874 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=Write, tablet=a940445cf22c41d2af967fed9d07c856, attempt=4, DeadlineTracker(timeout=30000, elapsed=61), Traces: [0ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [4ms] received from server b5851213ca55407284d76a9cea74db72 response Network error: connection closed, [5ms] delaying RPC due to Network error: connection closed, [37ms] querying master, [37ms] Sub rpc: GetTableLocations sending RPC to server , [40ms] Sub rpc: GetTableLocations received from server response OK, [44ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [48ms] received from server b5851213ca55407284d76a9cea74db72 response Network error: [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0x0011a834], [49ms] delaying RPC due to Network error: [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0x0011a834], [57ms] querying master, [57ms] Sub rpc: GetTableLocations sending RPC to server , [59ms] Sub rpc: GetTableLocations received from server response OK, Deferred@965895368(state=PENDING, result=null, callback=passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360), errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6f7d5822 -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360))) after lookup 03:46:33.875 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@783198451 returned Deferred@965895368(state=PENDING, result=null, callback=passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360) -> (continuation of Deferred@1639676145 after retry RPC@783198451), errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6f7d5822 -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360) -> (continuation of Deferred@1639676145 after retry RPC@783198451)), so the following Deferred is getting paused: Deferred@1639676145(state=PAUSED, result=Deferred@965895368, callback=, errback=) 03:46:33.878 [ERROR - New I/O boss #130] (Connection.java:436) [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0xfb6b0a82] java.net.ConnectException: Connection refused: /127.70.237.1:64036 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 03:46:33.879 [DEBUG - New I/O boss #130] (Connection.java:666) [peer b5851213ca55407284d76a9cea74db72] cleaning up while in state CONNECTING due to: [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0xfb6b0a82] 03:46:33.879 [INFO - New I/O boss #130] (AsyncKuduClient.java:1582) Removing server b5851213ca55407284d76a9cea74db72 from this tablet's cache a940445cf22c41d2af967fed9d07c856 03:46:33.879 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.879328 20972 log.cc:518] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Log is configured to *not* fsync() on all Append() calls 03:46:33.880 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.880720 20972 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 03:46:33.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.880944 20972 tablet_bootstrap.cc:433] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Bootstrap complete. 03:46:33.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.881227 20972 ts_tablet_manager.cc:823] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s 03:46:33.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.883270 20972 raft_consensus.cc:287] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:33.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.883571 20972 raft_consensus.cc:576] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6712fb9e95d482d881d3f8c58936d42, State: Initialized, Role: FOLLOWER 03:46:33.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.883666 20972 consensus_queue.cc:190] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:33.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:33.884336 20972 ts_tablet_manager.cc:851] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s 03:46:33.906 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.905995 20607 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64036 03:46:33.908 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.906322 20607 webserver.cc:149] Starting webserver on 127.70.237.1:64037 03:46:33.908 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.906332 20607 webserver.cc:160] Document root disabled 03:46:33.908 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.906725 20607 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64037/ 03:46:33.913 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet a940445cf22c41d2af967fed9d07c856 for table 'non-replicated' with partition [, ) 03:46:33.913 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=a940445cf22c41d2af967fed9d07c856, ttl=299999}] 03:46:33.914 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=Write, tablet=a940445cf22c41d2af967fed9d07c856, attempt=6, DeadlineTracker(timeout=30000, elapsed=101), Traces: [0ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [4ms] received from server b5851213ca55407284d76a9cea74db72 response Network error: connection closed, [5ms] delaying RPC due to Network error: connection closed, [37ms] querying master, [37ms] Sub rpc: GetTableLocations sending RPC to server , [40ms] Sub rpc: GetTableLocations received from server response OK, [44ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [48ms] received from server b5851213ca55407284d76a9cea74db72 response Network error: [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0x0011a834], [49ms] delaying RPC due to Network error: [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0x0011a834], [57ms] querying master, [57ms] Sub rpc: GetTableLocations sending RPC to server , [59ms] Sub rpc: GetTableLocations received from server response OK, [62ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [66ms] received from server b5851213ca55407284d76a9cea74db72 response Network error: [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0xfb6b0a82], [67ms] delaying RPC due to Network error: [peer b5851213ca55407284d76a9cea74db72] unexpected exception from downstream on [id: 0xfb6b0a82], [96ms] querying master, [97ms] Sub rpc: GetTableLocations sending RPC to server , [99ms] Sub rpc: GetTableLocations received from server response OK, Deferred@965895368(state=PENDING, result=null, callback=passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360) -> (continuation of Deferred@1639676145 after retry RPC@783198451), errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6f7d5822 -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360) -> (continuation of Deferred@1639676145 after retry RPC@783198451))) after lookup 03:46:33.915 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@724345807 returned Deferred@965895368(state=PENDING, result=null, callback=passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360) -> (continuation of Deferred@1639676145 after retry RPC@783198451) -> (continuation of Deferred@1881042793 after retry RPC@724345807), errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6f7d5822 -> wakeup thread Time-limited test -> (continuation of Deferred@1195037312 after retry RPC@1831100360) -> (continuation of Deferred@1639676145 after retry RPC@783198451) -> (continuation of Deferred@1881042793 after retry RPC@724345807)), so the following Deferred is getting paused: Deferred@1881042793(state=PAUSED, result=Deferred@965895368, callback=, errback=) 03:46:33.929 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.928987 21099 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:33.929 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.929133 21099 heartbeater.cc:387] Registering TS with master... 03:46:33.929 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.929472 21099 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:33.930 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:33.930469 18472 ts_manager.cc:87] Re-registered known tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:33.933 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.933313 20607 tablet_server_main.cc:87] Tablet server successfully started. 03:46:33.934 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.934003 21109 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:33.934 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.934033 21109 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:33.934 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.934039 21109 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:33.936 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.936264 21100 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:33.936 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.936312 21100 heartbeater.cc:387] Registering TS with master... 03:46:33.936 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:33.936453 21100 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:33.937 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:33.937196 18645 ts_manager.cc:87] Re-registered known tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:33.984 [DEBUG - New I/O worker #75] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:34.024 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.023901 21107 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:34.024 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.023979 21107 heartbeater.cc:387] Registering TS with master... 03:46:34.024 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.024152 21107 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:34.026 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.025471 18790 ts_manager.cc:87] Re-registered known tserver with Master: b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) 03:46:34.026 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.025887 18790 catalog_manager.cc:2511] T a940445cf22c41d2af967fed9d07c856 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b5851213ca55407284d76a9cea74db72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } } 03:46:34.038 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.037569 20726 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64040 03:46:34.038 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.037927 20726 webserver.cc:149] Starting webserver on 127.70.237.1:64041 03:46:34.038 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.037938 20726 webserver.cc:160] Document root disabled 03:46:34.038 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.038384 20726 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64041/ 03:46:34.039 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.039180 18789 catalog_manager.cc:1533] Servicing DeleteTable request from {username='jenkins-slave'} at 127.0.0.1:41428: 03:46:34.039 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) table { table_name: "non-replicated" } 03:46:34.042 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.042095 20726 tablet_server_main.cc:87] Tablet server successfully started. 03:46:34.042 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.042716 21178 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:34.042 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.042742 21178 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:34.042 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.042769 21178 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:34.053 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.053025 21173 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:34.053 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.053184 21173 heartbeater.cc:387] Registering TS with master... 03:46:34.053 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.053294 21176 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:34.053 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.053335 21176 heartbeater.cc:387] Registering TS with master... 03:46:34.053 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.053556 21176 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:34.054 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.054585 18788 ts_manager.cc:87] Re-registered known tserver with Master: f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040) 03:46:34.054 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.053557 21173 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:34.054 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.053030 21174 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:34.054 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.054126 21174 heartbeater.cc:387] Registering TS with master... 03:46:34.055 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.054229 21174 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:34.055 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.055395 18788 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:59195 03:46:34.062 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:34.061787 18472 ts_manager.cc:87] Re-registered known tserver with Master: f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040) 03:46:34.065 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:34.064918 18645 ts_manager.cc:87] Re-registered known tserver with Master: f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040) 03:46:34.080 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.074144 18789 catalog_manager.cc:3448] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Sending DeleteTablet for 1 replicas of tablet a940445cf22c41d2af967fed9d07c856 03:46:34.080 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.074580 18789 catalog_manager.cc:3105] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet a940445cf22c41d2af967fed9d07c856 on b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) (Table deleted at 2017-09-18 03:46:34 UTC) 03:46:34.080 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.075625 18790 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:44748 03:46:34.088 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.087707 20982 tablet_service.cc:805] Processing DeleteTablet for tablet a940445cf22c41d2af967fed9d07c856 with delete_type TABLET_DATA_DELETED (Table deleted at 2017-09-18 03:46:34 UTC) from {username='jenkins-slave'} at 127.70.237.1:44353 03:46:34.088 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.087815 20982 tablet_replica.cc:251] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: stopping tablet replica 03:46:34.088 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.087903 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op CompactRowSetsOp(a940445cf22c41d2af967fed9d07c856) 03:46:34.088 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.087929 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op MinorDeltaCompactionOp(a940445cf22c41d2af967fed9d07c856) 03:46:34.088 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.087939 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op MajorDeltaCompactionOp(a940445cf22c41d2af967fed9d07c856) 03:46:34.088 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.087946 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op UndoDeltaBlockGCOp(a940445cf22c41d2af967fed9d07c856) 03:46:34.088 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.087990 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op FlushMRSOp(a940445cf22c41d2af967fed9d07c856) 03:46:34.088 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.087997 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op FlushDeltaMemStoresOp(a940445cf22c41d2af967fed9d07c856) 03:46:34.089 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.088003 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op LogGCOp(a940445cf22c41d2af967fed9d07c856) 03:46:34.089 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.088057 20982 raft_consensus.cc:1807] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 2 LEADER]: Raft consensus shutting down. 03:46:34.089 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.088230 20982 raft_consensus.cc:1834] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72 [term 2 FOLLOWER]: Raft consensus is shut down! 03:46:34.094 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.094692 18718 catalog_manager.cc:3083] TS b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036): tablet a940445cf22c41d2af967fed9d07c856 (table non-replicated [id=76b508c390a54f5bbdc58c20e8c51073]) successfully deleted 03:46:34.094 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.090432 20982 ts_tablet_manager.cc:1123] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Deleting tablet data with delete state TABLET_DATA_DELETED 03:46:34.095 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.092916 20982 ts_tablet_manager.cc:1136] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: tablet deleted: last-logged OpId: 2.4 03:46:34.095 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.092967 20982 log.cc:960] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Deleting WAL directory at /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data/wals/a940445cf22c41d2af967fed9d07c856 03:46:34.095 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.093163 20982 ts_tablet_manager.cc:1154] T a940445cf22c41d2af967fed9d07c856 P b5851213ca55407284d76a9cea74db72: Deleting consensus metadata 03:46:34.096 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3d513880, flushNotification=Deferred@963558386(state=PENDING, result=null, callback=, errback=)} 03:46:34.098 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@7c6c32bb@2087465659 returned Deferred@2038165364(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1297763811 after org.apache.kudu.client.AsyncKuduSession$1@7c6c32bb@2087465659), errback=passthrough -> (continuation of Deferred@1297763811 after org.apache.kudu.client.AsyncKuduSession$1@7c6c32bb@2087465659)), so the following Deferred is getting paused: Deferred@1297763811(state=PAUSED, result=Deferred@2038165364, callback=, errback=) 03:46:34.103 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet c44211462fbc43959f0265b9662f4f5c for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:34.104 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=c44211462fbc43959f0265b9662f4f5c, ttl=299999}] 03:46:34.104 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=null, attempt=1, DeadlineTracker(timeout=30000, elapsed=7), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response OK, Deferred@1255730539(state=PENDING, result=null, callback=apply batch response, errback=apply batch error response))} after lookup 03:46:34.107 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@449354764 returned Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764)), so the following Deferred is getting paused: Deferred@1412724289(state=PAUSED, result=Deferred@1255730539, callback=notify DeferredGroup@1473392265, errback=notify DeferredGroup@1473392265) 03:46:34.120 [DEBUG - New I/O worker #75] (RemoteTablet.java:133) b5851213ca55407284d76a9cea74db72 was demoted as the leader for c44211462fbc43959f0265b9662f4f5c 03:46:34.132 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet c44211462fbc43959f0265b9662f4f5c for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:34.132 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=c44211462fbc43959f0265b9662f4f5c, ttl=299999}] 03:46:34.132 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=c44211462fbc43959f0265b9662f4f5c, attempt=3, DeadlineTracker(timeout=30000, elapsed=35), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response OK, [7ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [24ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [24ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [32ms] querying master, [32ms] Sub rpc: GetTableLocations sending RPC to server , [34ms] Sub rpc: GetTableLocations received from server response OK, Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764)))} after lookup 03:46:34.133 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1517036205 returned Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205)), so the following Deferred is getting paused: Deferred@68877584(state=PAUSED, result=Deferred@1255730539, callback=, errback=) 03:46:34.136 [DEBUG - New I/O worker #75] (RemoteTablet.java:133) b5851213ca55407284d76a9cea74db72 was demoted as the leader for c44211462fbc43959f0265b9662f4f5c 03:46:34.156 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet c44211462fbc43959f0265b9662f4f5c for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:34.157 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=c44211462fbc43959f0265b9662f4f5c, ttl=299999}] 03:46:34.158 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=c44211462fbc43959f0265b9662f4f5c, attempt=5, DeadlineTracker(timeout=30000, elapsed=60), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response OK, [7ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [24ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [24ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [32ms] querying master, [32ms] Sub rpc: GetTableLocations sending RPC to server , [34ms] Sub rpc: GetTableLocations received from server response OK, [36ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [39ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [39ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [57ms] querying master, [57ms] Sub rpc: GetTableLocations sending RPC to server , [59ms] Sub rpc: GetTableLocations received from server response OK, Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205)))} after lookup 03:46:34.162 [DEBUG - New I/O worker #75] (RemoteTablet.java:133) b5851213ca55407284d76a9cea74db72 was demoted as the leader for c44211462fbc43959f0265b9662f4f5c 03:46:34.163 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1944782252 returned Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252)), so the following Deferred is getting paused: Deferred@898353982(state=PAUSED, result=Deferred@1255730539, callback=, errback=) 03:46:34.191 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet c44211462fbc43959f0265b9662f4f5c for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:34.192 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=c44211462fbc43959f0265b9662f4f5c, ttl=299999}] 03:46:34.193 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=c44211462fbc43959f0265b9662f4f5c, attempt=7, DeadlineTracker(timeout=30000, elapsed=95), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response OK, [7ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [24ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [24ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [32ms] querying master, [32ms] Sub rpc: GetTableLocations sending RPC to server , [34ms] Sub rpc: GetTableLocations received from server response OK, [36ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [39ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [39ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [57ms] querying master, [57ms] Sub rpc: GetTableLocations sending RPC to server , [59ms] Sub rpc: GetTableLocations received from server response OK, [61ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [66ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [66ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [92ms] querying master, [92ms] Sub rpc: GetTableLocations sending RPC to server , [94ms] Sub rpc: GetTableLocations received from server response OK, Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252)))} after lookup 03:46:34.194 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@248114792 returned Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792)), so the following Deferred is getting paused: Deferred@1575514332(state=PAUSED, result=Deferred@1255730539, callback=, errback=) 03:46:34.197 [DEBUG - New I/O worker #75] (RemoteTablet.java:133) b5851213ca55407284d76a9cea74db72 was demoted as the leader for c44211462fbc43959f0265b9662f4f5c 03:46:34.432 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet c44211462fbc43959f0265b9662f4f5c for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:34.433 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=c44211462fbc43959f0265b9662f4f5c, ttl=299999}] 03:46:34.434 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=c44211462fbc43959f0265b9662f4f5c, attempt=9, DeadlineTracker(timeout=30000, elapsed=336), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response OK, [7ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [24ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [24ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [32ms] querying master, [32ms] Sub rpc: GetTableLocations sending RPC to server , [34ms] Sub rpc: GetTableLocations received from server response OK, [36ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [39ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [39ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [57ms] querying master, [57ms] Sub rpc: GetTableLocations sending RPC to server , [59ms] Sub rpc: GetTableLocations received from server response OK, [61ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [66ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [66ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [92ms] querying master, [92ms] Sub rpc: GetTableLocations sending RPC to server , [94ms] Sub rpc: GetTableLocations received from server response OK, [96ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [101ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [101ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [332ms] querying master, [332ms] Sub rpc: GetTableLocations sending RPC to server , [335ms] Sub rpc: GetTableLocations received from server response OK, Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792)))} after lookup 03:46:34.435 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1980094632 returned Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632)), so the following Deferred is getting paused: Deferred@490487661(state=PAUSED, result=Deferred@1255730539, callback=, errback=) 03:46:34.438 [DEBUG - New I/O worker #75] (RemoteTablet.java:133) b5851213ca55407284d76a9cea74db72 was demoted as the leader for c44211462fbc43959f0265b9662f4f5c 03:46:34.612 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet c44211462fbc43959f0265b9662f4f5c for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:34.613 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=c44211462fbc43959f0265b9662f4f5c, ttl=299999}] 03:46:34.614 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=c44211462fbc43959f0265b9662f4f5c, attempt=11, DeadlineTracker(timeout=30000, elapsed=516), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response OK, [7ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [24ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [24ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [32ms] querying master, [32ms] Sub rpc: GetTableLocations sending RPC to server , [34ms] Sub rpc: GetTableLocations received from server response OK, [36ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [39ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [39ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [57ms] querying master, [57ms] Sub rpc: GetTableLocations sending RPC to server , [59ms] Sub rpc: GetTableLocations received from server response OK, [61ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [66ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [66ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [92ms] querying master, [92ms] Sub rpc: GetTableLocations sending RPC to server , [94ms] Sub rpc: GetTableLocations received from server response OK, [96ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [101ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [101ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [332ms] querying master, [332ms] Sub rpc: GetTableLocations sending RPC to server , [335ms] Sub rpc: GetTableLocations received from server response OK, [337ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [343ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [343ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [512ms] querying master, [512ms] Sub rpc: GetTableLocations sending RPC to server , [515ms] Sub rpc: GetTableLocations received from server response OK, Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632)))} after lookup 03:46:34.628 [DEBUG - New I/O worker #75] (RemoteTablet.java:133) b5851213ca55407284d76a9cea74db72 was demoted as the leader for c44211462fbc43959f0265b9662f4f5c 03:46:34.629 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1548171276 returned Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632) -> (continuation of Deferred@1110953416 after retry RPC@1548171276), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632) -> (continuation of Deferred@1110953416 after retry RPC@1548171276)), so the following Deferred is getting paused: Deferred@1110953416(state=PAUSED, result=Deferred@1255730539, callback=, errback=) 03:46:34.724 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.724853 21210 raft_consensus.cc:412] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:34.725 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.725389 21210 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 2.200s (starting election) 03:46:34.725 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.725802 21210 raft_consensus.cc:434] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:34.726 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.726750 21210 leader_election.cc:221] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 pre-election: Requesting pre-vote from peer f6712fb9e95d482d881d3f8c58936d42 03:46:34.728 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.728106 21210 leader_election.cc:221] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 pre-election: Requesting pre-vote from peer a3f9940e383340d9b9cf3adbabf5612d 03:46:34.751 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.750686 21115 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "c44211462fbc43959f0265b9662f4f5c" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6712fb9e95d482d881d3f8c58936d42" is_pre_election: true 03:46:34.751 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.750918 21115 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Snoozing failure detection for 1.500s (vote granted) 03:46:34.751 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.750984 21115 raft_consensus.cc:2010] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5851213ca55407284d76a9cea74db72 in term 1. 03:46:34.752 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.752408 20653 leader_election.cc:353] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 pre-election: Vote granted by peer f6712fb9e95d482d881d3f8c58936d42 03:46:34.752 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.752544 20653 leader_election.cc:248] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. 03:46:34.753 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.753083 21210 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 2.076s (election complete) 03:46:34.753 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.753309 21210 raft_consensus.cc:2280] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Leader pre-election won for term 2 03:46:34.753 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.753487 21210 raft_consensus.cc:412] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:34.753 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.753661 21210 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.993s (starting election) 03:46:34.753 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.753855 21210 raft_consensus.cc:2508] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Advancing to term 2 03:46:34.755 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.755164 21210 raft_consensus.cc:434] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:34.757 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.757091 21210 leader_election.cc:221] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 election: Requesting vote from peer f6712fb9e95d482d881d3f8c58936d42 03:46:34.759 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.757902 21115 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "c44211462fbc43959f0265b9662f4f5c" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6712fb9e95d482d881d3f8c58936d42" 03:46:34.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.757985 21115 raft_consensus.cc:2508] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 1 FOLLOWER]: Advancing to term 2 03:46:34.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.758101 21115 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Snoozing failure detection for 2.054s (vote granted) 03:46:34.760 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:34.759723 21115 raft_consensus.cc:2010] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5851213ca55407284d76a9cea74db72 in term 2. 03:46:34.760 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.760581 20653 leader_election.cc:353] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 election: Vote granted by peer f6712fb9e95d482d881d3f8c58936d42 03:46:34.760 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.760618 20653 leader_election.cc:248] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. 03:46:34.763 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.763260 21210 leader_election.cc:221] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 election: Requesting vote from peer a3f9940e383340d9b9cf3adbabf5612d 03:46:34.772 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:34.769368 20869 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "c44211462fbc43959f0265b9662f4f5c" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3f9940e383340d9b9cf3adbabf5612d" is_pre_election: true 03:46:34.772 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:34.769579 20869 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Snoozing failure detection for 1.708s (vote granted) 03:46:34.772 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:34.769644 20869 raft_consensus.cc:2010] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5851213ca55407284d76a9cea74db72 in term 1. 03:46:34.772 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:34.770328 20868 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "c44211462fbc43959f0265b9662f4f5c" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3f9940e383340d9b9cf3adbabf5612d" 03:46:34.772 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:34.770385 20868 raft_consensus.cc:2508] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Advancing to term 2 03:46:34.772 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:34.770488 20868 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Snoozing failure detection for 1.928s (vote granted) 03:46:34.772 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:34.772071 20868 raft_consensus.cc:2010] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5851213ca55407284d76a9cea74db72 in term 2. 03:46:34.773 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.773403 20650 leader_election.cc:353] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 pre-election: Vote granted by peer a3f9940e383340d9b9cf3adbabf5612d 03:46:34.773 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.773691 20650 leader_election.cc:353] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 2 election: Vote granted by peer a3f9940e383340d9b9cf3adbabf5612d 03:46:34.774 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.774255 21210 raft_consensus.cc:2456] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 2.121s (election complete) 03:46:34.774 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.774494 21210 raft_consensus.cc:2280] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 2 FOLLOWER]: Leader election won for term 2 03:46:34.775 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.775475 21107 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:34.775 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.775838 21210 raft_consensus.cc:542] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 2 LEADER]: Becoming Leader. State: Replica: b5851213ca55407284d76a9cea74db72, State: Running, Role: LEADER 03:46:34.776 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:34.776257 21210 consensus_queue.cc:169] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:34.787 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:34.787174 18790 catalog_manager.cc:2511] T c44211462fbc43959f0265b9662f4f5c reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b5851213ca55407284d76a9cea74db72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } 03:46:34.872 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:34.871723 20963 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:35.057 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:35.057137 21176 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:35.218 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:35.217579 21115 raft_consensus.cc:964] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 2 FOLLOWER]: Refusing update from remote peer b5851213ca55407284d76a9cea74db72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch) 03:46:35.219 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:35.218952 21210 consensus_queue.cc:741] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [LEADER]: Connected to new peer: Peer: f6712fb9e95d482d881d3f8c58936d42, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:35.296 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:35.294955 20868 raft_consensus.cc:964] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 2 FOLLOWER]: Refusing update from remote peer b5851213ca55407284d76a9cea74db72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch) 03:46:35.298 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:35.298236 21210 consensus_queue.cc:741] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [LEADER]: Connected to new peer: Peer: a3f9940e383340d9b9cf3adbabf5612d, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:35.612 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet c44211462fbc43959f0265b9662f4f5c for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:35.612 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=c44211462fbc43959f0265b9662f4f5c, ttl=299999}] 03:46:35.614 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=c44211462fbc43959f0265b9662f4f5c, attempt=13, DeadlineTracker(timeout=30000, elapsed=1515), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response OK, [7ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [24ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [24ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [32ms] querying master, [32ms] Sub rpc: GetTableLocations sending RPC to server , [34ms] Sub rpc: GetTableLocations received from server response OK, [36ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [39ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [39ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [57ms] querying master, [57ms] Sub rpc: GetTableLocations sending RPC to server , [59ms] Sub rpc: GetTableLocations received from server response OK, [61ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [66ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [66ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [92ms] querying master, [92ms] Sub rpc: GetTableLocations sending RPC to server , [94ms] Sub rpc: GetTableLocations received from server response OK, [96ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [101ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [101ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [332ms] querying master, [332ms] Sub rpc: GetTableLocations sending RPC to server , [335ms] Sub rpc: GetTableLocations received from server response OK, [337ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [343ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [343ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [512ms] querying master, [512ms] Sub rpc: GetTableLocations sending RPC to server , [515ms] Sub rpc: GetTableLocations received from server response OK, [518ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [531ms] delaying RPC due to Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [531ms] received from server b5851213ca55407284d76a9cea74db72 response Illegal state: Replica b5851213ca55407284d76a9cea74db72 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } (error 0), [1512ms] querying master, [1512ms] Sub rpc: GetTableLocations sending RPC to server , [1514ms] Sub rpc: GetTableLocations received from server response OK, Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632) -> (continuation of Deferred@1110953416 after retry RPC@1548171276), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632) -> (continuation of Deferred@1110953416 after retry RPC@1548171276)))} after lookup 03:46:35.631 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@447716798 returned Deferred@1255730539(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632) -> (continuation of Deferred@1110953416 after retry RPC@1548171276) -> (continuation of Deferred@1712590545 after retry RPC@447716798), errback=apply batch error response -> (continuation of Deferred@1412724289 after retry RPC@449354764) -> (continuation of Deferred@68877584 after retry RPC@1517036205) -> (continuation of Deferred@898353982 after retry RPC@1944782252) -> (continuation of Deferred@1575514332 after retry RPC@248114792) -> (continuation of Deferred@490487661 after retry RPC@1980094632) -> (continuation of Deferred@1110953416 after retry RPC@1548171276) -> (continuation of Deferred@1712590545 after retry RPC@447716798)), so the following Deferred is getting paused: Deferred@1712590545(state=PAUSED, result=Deferred@1255730539, callback=, errback=) 03:46:35.779 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 1 rows, more=false) 03:46:35.941 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:35.946 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:35.958 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:35.967 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:35.968 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=null, flushNotification=Deferred@27774609(state=PENDING, result=null, callback=, errback=)} 03:46:36.009 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:36.068 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:36.069 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1c43cdf4, flushNotification=Deferred@988123463(state=PENDING, result=null, callback=, errback=)} 03:46:36.088 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:37.089 [DEBUG - Hashed wheel timer #2] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@66d499c4, flushNotification=Deferred@1746107246(state=PENDING, result=null, callback=, errback=)} 03:46:37.231 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 11 rows, more=false) 03:46:37.250 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 31 rows, more=false) 03:46:37.261 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 03:46:37.271 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 03:46:37.272 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@634386093(state=PENDING, result=null, callback=, errback=)} 03:46:37.273 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@1aa367c3@446916547 returned Deferred@403518734(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1746107246 after org.apache.kudu.client.AsyncKuduSession$1@1aa367c3@446916547), errback=passthrough -> (continuation of Deferred@1746107246 after org.apache.kudu.client.AsyncKuduSession$1@1aa367c3@446916547)), so the following Deferred is getting paused: Deferred@1746107246(state=PAUSED, result=Deferred@403518734, callback=, errback=) 03:46:37.297 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:37.312 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:37.313 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@242544865(state=PENDING, result=null, callback=, errback=)} 03:46:37.315 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@5454151c@1414796572 returned Deferred@1430846762(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@634386093 after org.apache.kudu.client.AsyncKuduSession$1@5454151c@1414796572), errback=passthrough -> (continuation of Deferred@634386093 after org.apache.kudu.client.AsyncKuduSession$1@5454151c@1414796572)), so the following Deferred is getting paused: Deferred@634386093(state=PAUSED, result=Deferred@1430846762, callback=, errback=) 03:46:37.331 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:37.463 [DEBUG - New I/O worker #75] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:37.464 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@249c07c8, flushNotification=Deferred@231086146(state=PENDING, result=null, callback=, errback=)} 03:46:37.473 [DEBUG - New I/O worker #75] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:37.490 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@79ce1013, flushNotification=Deferred@1811743661(state=PENDING, result=null, callback=, errback=)} 03:46:37.505 [DEBUG - New I/O worker #75] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=16), No traces, null) with no deferred attached! 03:46:37.585 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.585125 18790 catalog_manager.cc:1533] Servicing DeleteTable request from {username='jenkins-slave'} at 127.0.0.1:41428: 03:46:37.585 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) table { table_name: "org.apache.kudu.client.TestAsyncKuduSession-1505706385081" } 03:46:37.650 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.650221 18790 catalog_manager.cc:3448] T 00000000000000000000000000000000 P 2c3c210fb3054825a9fdb0c1d31e0e2b: Sending DeleteTablet for 3 replicas of tablet c44211462fbc43959f0265b9662f4f5c 03:46:37.651 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.650300 18790 catalog_manager.cc:3105] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet c44211462fbc43959f0265b9662f4f5c on b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036) (Table deleted at 2017-09-18 03:46:37 UTC) 03:46:37.651 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.650560 18790 catalog_manager.cc:3105] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet c44211462fbc43959f0265b9662f4f5c on f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040) (Table deleted at 2017-09-18 03:46:37 UTC) 03:46:37.651 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.650696 18790 catalog_manager.cc:3105] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet c44211462fbc43959f0265b9662f4f5c on a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038) (Table deleted at 2017-09-18 03:46:37 UTC) 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652773 20982 tablet_service.cc:805] Processing DeleteTablet for tablet c44211462fbc43959f0265b9662f4f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2017-09-18 03:46:37 UTC) from {username='jenkins-slave'} at 127.70.237.1:44353 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652850 20982 tablet_replica.cc:251] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: stopping tablet replica 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652878 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op CompactRowSetsOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652889 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op MinorDeltaCompactionOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652894 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op MajorDeltaCompactionOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652897 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op UndoDeltaBlockGCOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652915 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op FlushMRSOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652920 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op FlushDeltaMemStoresOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652925 20982 maintenance_manager.cc:228] P b5851213ca55407284d76a9cea74db72: Unregistered op LogGCOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652951 20982 raft_consensus.cc:1807] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 2 LEADER]: Raft consensus shutting down. 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.652981 20982 consensus_peers.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 -> Peer a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038): Closing peer: a3f9940e383340d9b9cf3adbabf5612d 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.653023 20982 consensus_peers.cc:433] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 -> Peer f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040): Closing peer: f6712fb9e95d482d881d3f8c58936d42 03:46:37.653 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.653188 20982 raft_consensus.cc:1834] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72 [term 2 FOLLOWER]: Raft consensus is shut down! 03:46:37.656 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.654685 20982 ts_tablet_manager.cc:1123] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Deleting tablet data with delete state TABLET_DATA_DELETED 03:46:37.656 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.656114 20982 ts_tablet_manager.cc:1136] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: tablet deleted: last-logged OpId: 2.32 03:46:37.656 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.656141 20982 log.cc:960] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Deleting WAL directory at /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706386661/data/wals/c44211462fbc43959f0265b9662f4f5c 03:46:37.656 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.656285 20982 ts_tablet_manager.cc:1154] T c44211462fbc43959f0265b9662f4f5c P b5851213ca55407284d76a9cea74db72: Deleting consensus metadata 03:46:37.664 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.664343 18718 catalog_manager.cc:3083] TS b5851213ca55407284d76a9cea74db72 (127.70.237.1:64036): tablet c44211462fbc43959f0265b9662f4f5c (table org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=ad080cebfaf843d28992272bb40f60d0]) successfully deleted 03:46:37.664 [WARN - Time-limited test] (RpcProxy.java:125) [peer b5851213ca55407284d76a9cea74db72] sending RPC with no timeout KuduRpc(method=ListTablets, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=0), Traces: [0ms] sending RPC to server b5851213ca55407284d76a9cea74db72, Deferred@1557279707(state=PENDING, result=null, callback=, errback=)) 03:46:37.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680047 21066 tablet_service.cc:805] Processing DeleteTablet for tablet c44211462fbc43959f0265b9662f4f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2017-09-18 03:46:37 UTC) from {username='jenkins-slave'} at 127.70.237.1:47259 03:46:37.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680130 21066 tablet_replica.cc:251] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: stopping tablet replica 03:46:37.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680202 21066 maintenance_manager.cc:228] P f6712fb9e95d482d881d3f8c58936d42: Unregistered op CompactRowSetsOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680217 21066 maintenance_manager.cc:228] P f6712fb9e95d482d881d3f8c58936d42: Unregistered op MinorDeltaCompactionOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680223 21066 maintenance_manager.cc:228] P f6712fb9e95d482d881d3f8c58936d42: Unregistered op MajorDeltaCompactionOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680228 21066 maintenance_manager.cc:228] P f6712fb9e95d482d881d3f8c58936d42: Unregistered op UndoDeltaBlockGCOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.681 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680260 21066 maintenance_manager.cc:228] P f6712fb9e95d482d881d3f8c58936d42: Unregistered op FlushMRSOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.681 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680265 21066 maintenance_manager.cc:228] P f6712fb9e95d482d881d3f8c58936d42: Unregistered op FlushDeltaMemStoresOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.681 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680269 21066 maintenance_manager.cc:228] P f6712fb9e95d482d881d3f8c58936d42: Unregistered op LogGCOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.681 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680310 21066 raft_consensus.cc:1807] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 2 FOLLOWER]: Raft consensus shutting down. 03:46:37.681 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.680480 21066 raft_consensus.cc:1834] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42 [term 2 FOLLOWER]: Raft consensus is shut down! 03:46:37.688 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.688686 18732 catalog_manager.cc:3083] TS f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1:64040): tablet c44211462fbc43959f0265b9662f4f5c (table org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=ad080cebfaf843d28992272bb40f60d0]) successfully deleted 03:46:37.688 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.685555 21066 ts_tablet_manager.cc:1123] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Deleting tablet data with delete state TABLET_DATA_DELETED 03:46:37.689 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.687259 21066 ts_tablet_manager.cc:1136] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: tablet deleted: last-logged OpId: 2.32 03:46:37.689 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.687294 21066 log.cc:960] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Deleting WAL directory at /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706386661/data/wals/c44211462fbc43959f0265b9662f4f5c 03:46:37.689 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.687443 21066 ts_tablet_manager.cc:1154] T c44211462fbc43959f0265b9662f4f5c P f6712fb9e95d482d881d3f8c58936d42: Deleting consensus metadata 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695524 20848 tablet_service.cc:805] Processing DeleteTablet for tablet c44211462fbc43959f0265b9662f4f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2017-09-18 03:46:37 UTC) from {username='jenkins-slave'} at 127.70.237.1:53770 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695611 20848 tablet_replica.cc:251] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: stopping tablet replica 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695682 20848 maintenance_manager.cc:228] P a3f9940e383340d9b9cf3adbabf5612d: Unregistered op CompactRowSetsOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695698 20848 maintenance_manager.cc:228] P a3f9940e383340d9b9cf3adbabf5612d: Unregistered op MinorDeltaCompactionOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695704 20848 maintenance_manager.cc:228] P a3f9940e383340d9b9cf3adbabf5612d: Unregistered op MajorDeltaCompactionOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695709 20848 maintenance_manager.cc:228] P a3f9940e383340d9b9cf3adbabf5612d: Unregistered op UndoDeltaBlockGCOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695741 20848 maintenance_manager.cc:228] P a3f9940e383340d9b9cf3adbabf5612d: Unregistered op FlushMRSOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695745 20848 maintenance_manager.cc:228] P a3f9940e383340d9b9cf3adbabf5612d: Unregistered op FlushDeltaMemStoresOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695750 20848 maintenance_manager.cc:228] P a3f9940e383340d9b9cf3adbabf5612d: Unregistered op LogGCOp(c44211462fbc43959f0265b9662f4f5c) 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695789 20848 raft_consensus.cc:1807] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 2 FOLLOWER]: Raft consensus shutting down. 03:46:37.696 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.695952 20848 raft_consensus.cc:1834] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d [term 2 FOLLOWER]: Raft consensus is shut down! 03:46:37.700 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.700060 18726 catalog_manager.cc:3083] TS a3f9940e383340d9b9cf3adbabf5612d (127.70.237.1:64038): tablet c44211462fbc43959f0265b9662f4f5c (table org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=ad080cebfaf843d28992272bb40f60d0]) successfully deleted 03:46:37.700 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.697048 20848 ts_tablet_manager.cc:1123] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Deleting tablet data with delete state TABLET_DATA_DELETED 03:46:37.700 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.698734 20848 ts_tablet_manager.cc:1136] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: tablet deleted: last-logged OpId: 2.32 03:46:37.700 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.698767 20848 log.cc:960] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Deleting WAL directory at /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706386661/data/wals/c44211462fbc43959f0265b9662f4f5c 03:46:37.700 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.698909 20848 ts_tablet_manager.cc:1154] T c44211462fbc43959f0265b9662f4f5c P a3f9940e383340d9b9cf3adbabf5612d: Deleting consensus metadata 03:46:37.714 [INFO - New I/O worker #75] (AsyncKuduClient.java:1582) Removing server b5851213ca55407284d76a9cea74db72 from this tablet's cache c44211462fbc43959f0265b9662f4f5c 03:46:37.733 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:950) Notify RPC KuduRpc(method=Write, tablet=c44211462fbc43959f0265b9662f4f5c, attempt=2, DeadlineTracker(timeout=30000, elapsed=22), Traces: [0ms] sending RPC to server b5851213ca55407284d76a9cea74db72, [4ms] delaying RPC due to Not found: Tablet not found: c44211462fbc43959f0265b9662f4f5c (error 0), [4ms] received from server b5851213ca55407284d76a9cea74db72 response Not found: Tablet not found: c44211462fbc43959f0265b9662f4f5c (error 0), [18ms] querying master, [18ms] Sub rpc: GetTableLocations sending RPC to server , [22ms] Sub rpc: GetTableLocations received from server response Not found: The table was deleted: Table deleted at 2017-09-18 03:46:37 UTC (error 0), Deferred@66510151(state=PENDING, result=null, callback=passthrough -> wakeup thread Time-limited test, errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@7f53097c -> wakeup thread Time-limited test)) after lookup exception org.apache.kudu.client.NonRecoverableException: The table was deleted: Table deleted at 2017-09-18 03:46:37 UTC at org.apache.kudu.client.RpcProxy.dispatchMasterError(RpcProxy.java:360) at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:253) at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:60) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:132) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:128) at org.apache.kudu.client.Connection.messageReceived(Connection.java:375) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.Connection.handleUpstream(Connection.java:239) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.handler.timeout.ReadTimeoutHandler.messageReceived(ReadTimeoutHandler.java:184) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 03:46:37.734 [INFO - Time-limited test] (BaseKuduTest.java:131) Creating table: org.apache.kudu.client.TestAsyncKuduSession-1505706385081 03:46:37.735 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:37.735729 18790 catalog_manager.cc:1211] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:41428: 03:46:37.735 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "org.apache.kudu.client.TestAsyncKuduSession-1505706385081" 03:46:37.735 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) schema { 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: true 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column1_i" 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column2_i" 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column3_s" 03:46:37.736 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: STRING 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: true 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) compression: LZ4 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 4096 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column4_b" 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: BOOL 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) partition_schema { 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) range_schema { 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.737 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:37.754 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.753588 21066 tablet_service.cc:764] Processing CreateTablet for tablet afce87139a9f488abb6963831b58cca9 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=afe1807b5c2c4de9adad24bcacfc3a5c]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:37.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.753615 20982 tablet_service.cc:764] Processing CreateTablet for tablet afce87139a9f488abb6963831b58cca9 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=afe1807b5c2c4de9adad24bcacfc3a5c]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:37.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.755959 20982 ts_tablet_manager.cc:948] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: Registered tablet (data state: TABLET_DATA_READY) 03:46:37.759 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@5fd3ce3c@1607716412 returned Deferred@1786395748(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@d05d0be -> (continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$1@5fd3ce3c@1607716412), errback=passthrough -> (continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$1@5fd3ce3c@1607716412)), so the following Deferred is getting paused: Deferred@764964170(state=PAUSED, result=Deferred@1786395748, callback=org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb -> wakeup thread Time-limited test, errback=passthrough -> wakeup thread Time-limited test) 03:46:37.763 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.763483 20848 tablet_service.cc:764] Processing CreateTablet for tablet afce87139a9f488abb6963831b58cca9 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=afe1807b5c2c4de9adad24bcacfc3a5c]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:37.765 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.765733 20848 ts_tablet_manager.cc:948] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: Registered tablet (data state: TABLET_DATA_READY) 03:46:37.767 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:571) Opened table afe1807b5c2c4de9adad24bcacfc3a5c 03:46:37.767 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563)), so the following Deferred is getting paused: Deferred@764964170(state=PAUSED, result=Deferred@1465482252, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 03:46:37.769 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.769397 21533 ts_tablet_manager.cc:798] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: Bootstrapping tablet 03:46:37.769 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.769836 21533 tablet_bootstrap.cc:433] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: Bootstrap starting. 03:46:37.774 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.774574 21533 tablet_bootstrap.cc:568] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: No blocks or log segments found. Creating new log. 03:46:37.777 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.776449 21066 ts_tablet_manager.cc:948] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Registered tablet (data state: TABLET_DATA_READY) 03:46:37.777 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353)), so the following Deferred is getting paused: Deferred@451282817(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:37.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.781213 21533 tablet_bootstrap.cc:433] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: No bootstrap required, opened a new log 03:46:37.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.781348 21533 ts_tablet_manager.cc:823] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.000s 03:46:37.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.781901 21533 raft_consensus.cc:287] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:37.782 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.781951 21533 raft_consensus.cc:313] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:37.782 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.782124 21533 raft_consensus.cc:576] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5851213ca55407284d76a9cea74db72, State: Initialized, Role: FOLLOWER 03:46:37.782 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.782173 21533 consensus_queue.cc:190] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:37.786 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:37.786057 21533 ts_tablet_manager.cc:851] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s 03:46:37.788 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.788771 21539 ts_tablet_manager.cc:798] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: Bootstrapping tablet 03:46:37.789 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.789232 21539 tablet_bootstrap.cc:433] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: Bootstrap starting. 03:46:37.790 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.790273 21539 tablet_bootstrap.cc:568] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: No blocks or log segments found. Creating new log. 03:46:37.791 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202)), so the following Deferred is getting paused: Deferred@892093611(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:37.795 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.795306 21542 ts_tablet_manager.cc:798] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Bootstrapping tablet 03:46:37.796 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.796406 21542 tablet_bootstrap.cc:433] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Bootstrap starting. 03:46:37.797 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.797534 21542 tablet_bootstrap.cc:568] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: No blocks or log segments found. Creating new log. 03:46:37.802 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.801618 21539 tablet_bootstrap.cc:433] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: No bootstrap required, opened a new log 03:46:37.802 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.801741 21539 ts_tablet_manager.cc:823] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.000s 03:46:37.802 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.802379 21539 raft_consensus.cc:287] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:37.803 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.802403 21539 raft_consensus.cc:313] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:37.803 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.802500 21539 raft_consensus.cc:576] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f9940e383340d9b9cf3adbabf5612d, State: Initialized, Role: FOLLOWER 03:46:37.803 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.802536 21539 consensus_queue.cc:190] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:37.809 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:37.809011 21539 ts_tablet_manager.cc:851] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: Time spent starting tablet: real 0.007s user 0.000s sys 0.004s 03:46:37.811 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785)), so the following Deferred is getting paused: Deferred@1035420191(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:37.831 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287)), so the following Deferred is getting paused: Deferred@203571919(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:37.845 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.844667 21542 tablet_bootstrap.cc:433] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: No bootstrap required, opened a new log 03:46:37.846 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.844810 21542 ts_tablet_manager.cc:823] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.000s 03:46:37.846 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.845510 21542 raft_consensus.cc:287] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:37.846 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.845540 21542 raft_consensus.cc:313] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:37.846 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.845644 21542 raft_consensus.cc:576] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6712fb9e95d482d881d3f8c58936d42, State: Initialized, Role: FOLLOWER 03:46:37.846 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.845690 21542 consensus_queue.cc:190] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:37.851 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983)), so the following Deferred is getting paused: Deferred@541420454(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:37.861 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:37.857427 21542 ts_tablet_manager.cc:851] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s 03:46:37.893 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983) -> (continuation of Deferred@122292740 after org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983) -> (continuation of Deferred@122292740 after org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461)), so the following Deferred is getting paused: Deferred@122292740(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:37.912 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@bb4e208@196403720 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983) -> (continuation of Deferred@122292740 after org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461) -> (continuation of Deferred@2601091 after org.apache.kudu.client.AsyncKuduClient$12@bb4e208@196403720), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983) -> (continuation of Deferred@122292740 after org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461) -> (continuation of Deferred@2601091 after org.apache.kudu.client.AsyncKuduClient$12@bb4e208@196403720)), so the following Deferred is getting paused: Deferred@2601091(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:37.971 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@19e00125@434110757 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983) -> (continuation of Deferred@122292740 after org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461) -> (continuation of Deferred@2601091 after org.apache.kudu.client.AsyncKuduClient$12@bb4e208@196403720) -> (continuation of Deferred@1311584823 after org.apache.kudu.client.AsyncKuduClient$12@19e00125@434110757), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983) -> (continuation of Deferred@122292740 after org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461) -> (continuation of Deferred@2601091 after org.apache.kudu.client.AsyncKuduClient$12@bb4e208@196403720) -> (continuation of Deferred@1311584823 after org.apache.kudu.client.AsyncKuduClient$12@19e00125@434110757)), so the following Deferred is getting paused: Deferred@1311584823(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:38.011 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@62a52d58@1654992216 returned Deferred@1465482252(state=PENDING, result=null, callback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983) -> (continuation of Deferred@122292740 after org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461) -> (continuation of Deferred@2601091 after org.apache.kudu.client.AsyncKuduClient$12@bb4e208@196403720) -> (continuation of Deferred@1311584823 after org.apache.kudu.client.AsyncKuduClient$12@19e00125@434110757) -> (continuation of Deferred@1597717031 after org.apache.kudu.client.AsyncKuduClient$12@62a52d58@1654992216), errback=(continuation of Deferred@764964170 after org.apache.kudu.client.AsyncKuduClient$2@6cfbf4eb@1828451563) -> (continuation of Deferred@451282817 after org.apache.kudu.client.AsyncKuduClient$12@747ad679@1954207353) -> (continuation of Deferred@892093611 after org.apache.kudu.client.AsyncKuduClient$12@2909e49a@688514202) -> (continuation of Deferred@1035420191 after org.apache.kudu.client.AsyncKuduClient$12@17c78569@398951785) -> (continuation of Deferred@203571919 after org.apache.kudu.client.AsyncKuduClient$12@5bfc5c07@1543265287) -> (continuation of Deferred@541420454 after org.apache.kudu.client.AsyncKuduClient$12@276572ef@660959983) -> (continuation of Deferred@122292740 after org.apache.kudu.client.AsyncKuduClient$12@19e007cd@434112461) -> (continuation of Deferred@2601091 after org.apache.kudu.client.AsyncKuduClient$12@bb4e208@196403720) -> (continuation of Deferred@1311584823 after org.apache.kudu.client.AsyncKuduClient$12@19e00125@434110757) -> (continuation of Deferred@1597717031 after org.apache.kudu.client.AsyncKuduClient$12@62a52d58@1654992216)), so the following Deferred is getting paused: Deferred@1597717031(state=PAUSED, result=Deferred@1465482252, callback=, errback=) 03:46:38.041 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.039898 21569 raft_consensus.cc:412] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:38.041 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.039960 21569 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Snoozing failure detection for 1.788s (starting election) 03:46:38.041 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.040088 21569 raft_consensus.cc:434] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:38.041 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.041137 21569 leader_election.cc:221] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer a3f9940e383340d9b9cf3adbabf5612d 03:46:38.041 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.041409 21569 leader_election.cc:221] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b5851213ca55407284d76a9cea74db72 03:46:38.066 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.065780 20868 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "afce87139a9f488abb6963831b58cca9" candidate_uuid: "f6712fb9e95d482d881d3f8c58936d42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f9940e383340d9b9cf3adbabf5612d" is_pre_election: true 03:46:38.066 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.065910 20868 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: Snoozing failure detection for 1.612s (vote granted) 03:46:38.066 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.065954 20868 raft_consensus.cc:2010] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6712fb9e95d482d881d3f8c58936d42 in term 0. 03:46:38.067 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.067050 20806 leader_election.cc:353] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 pre-election: Vote granted by peer a3f9940e383340d9b9cf3adbabf5612d 03:46:38.067 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.067117 20806 leader_election.cc:248] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:38.069 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.067723 21569 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Snoozing failure detection for 1.857s (election complete) 03:46:38.069 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.067771 21569 raft_consensus.cc:2280] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:38.069 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.067785 21569 raft_consensus.cc:412] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:38.069 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.067796 21569 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Snoozing failure detection for 1.911s (starting election) 03:46:38.069 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.067806 21569 raft_consensus.cc:2508] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 0 FOLLOWER]: Advancing to term 1 03:46:38.072 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.071696 21569 raft_consensus.cc:434] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:38.072 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.072067 21569 leader_election.cc:221] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 election: Requesting vote from peer a3f9940e383340d9b9cf3adbabf5612d 03:46:38.072 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.072177 21569 leader_election.cc:221] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 election: Requesting vote from peer b5851213ca55407284d76a9cea74db72 03:46:38.074 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.073396 20868 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "afce87139a9f488abb6963831b58cca9" candidate_uuid: "f6712fb9e95d482d881d3f8c58936d42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f9940e383340d9b9cf3adbabf5612d" 03:46:38.074 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.073478 20868 raft_consensus.cc:2508] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 0 FOLLOWER]: Advancing to term 1 03:46:38.074 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.073552 20868 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d: Snoozing failure detection for 2.062s (vote granted) 03:46:38.075 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.074542 20868 raft_consensus.cc:2010] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6712fb9e95d482d881d3f8c58936d42 in term 1. 03:46:38.075 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.075417 21210 raft_consensus.cc:412] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:38.075 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.075448 20806 leader_election.cc:353] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 election: Vote granted by peer a3f9940e383340d9b9cf3adbabf5612d 03:46:38.075 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.075492 20806 leader_election.cc:248] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:38.075 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.075716 21210 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.509s (starting election) 03:46:38.076 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.075896 21210 raft_consensus.cc:434] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:38.076 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.076303 21210 leader_election.cc:221] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer a3f9940e383340d9b9cf3adbabf5612d 03:46:38.076 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.076232 21569 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42: Snoozing failure detection for 1.645s (election complete) 03:46:38.076 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.076285 21569 raft_consensus.cc:2280] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 1 FOLLOWER]: Leader election won for term 1 03:46:38.078 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.076469 21002 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "afce87139a9f488abb6963831b58cca9" candidate_uuid: "f6712fb9e95d482d881d3f8c58936d42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5851213ca55407284d76a9cea74db72" is_pre_election: true 03:46:38.078 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.076567 21001 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "afce87139a9f488abb6963831b58cca9" candidate_uuid: "f6712fb9e95d482d881d3f8c58936d42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5851213ca55407284d76a9cea74db72" 03:46:38.078 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.076658 21002 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.882s (vote granted) 03:46:38.078 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.076709 21002 raft_consensus.cc:2010] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6712fb9e95d482d881d3f8c58936d42 in term 0. 03:46:38.078 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.077405 21001 raft_consensus.cc:1985] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Leader election vote request: Denying vote to candidate f6712fb9e95d482d881d3f8c58936d42 for term 1 because replica is already servicing an update from a current leader or another vote. 03:46:38.078 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.077075 20801 leader_election.cc:353] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 pre-election: Vote granted by peer b5851213ca55407284d76a9cea74db72 03:46:38.078 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.077898 20801 leader_election.cc:367] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [CANDIDATE]: Term 1 election: Vote denied by peer b5851213ca55407284d76a9cea74db72. Message: Service unavailable: T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Leader election vote request: Denying vote to candidate f6712fb9e95d482d881d3f8c58936d42 for term 1 because replica is already servicing an update from a current leader or another vote. 03:46:38.079 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.079274 20868 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "afce87139a9f488abb6963831b58cca9" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f9940e383340d9b9cf3adbabf5612d" is_pre_election: true 03:46:38.079 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.079403 20868 raft_consensus.cc:1940] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5851213ca55407284d76a9cea74db72 in current term 1: Already voted for candidate f6712fb9e95d482d881d3f8c58936d42 in this term. 03:46:38.080 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.080248 20650 leader_election.cc:367] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Vote denied by peer a3f9940e383340d9b9cf3adbabf5612d. Message: Invalid argument: T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5851213ca55407284d76a9cea74db72 in current term 1: Already voted for candidate f6712fb9e95d482d881d3f8c58936d42 in this term. 03:46:38.080 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.080569 21210 leader_election.cc:221] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer f6712fb9e95d482d881d3f8c58936d42 03:46:38.081 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.081423 21115 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "afce87139a9f488abb6963831b58cca9" candidate_uuid: "b5851213ca55407284d76a9cea74db72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6712fb9e95d482d881d3f8c58936d42" is_pre_election: true 03:46:38.101 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.099951 21569 raft_consensus.cc:542] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 1 LEADER]: Becoming Leader. State: Replica: f6712fb9e95d482d881d3f8c58936d42, State: Running, Role: LEADER 03:46:38.102 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.100281 21569 consensus_queue.cc:169] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:38.111 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.110968 20653 leader_election.cc:367] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Vote denied by peer f6712fb9e95d482d881d3f8c58936d42. Message: Invalid argument: T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate b5851213ca55407284d76a9cea74db72 for term 1 because replica is either leader or believes a valid leader to be alive. 03:46:38.111 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.111024 20653 leader_election.cc:248] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. 03:46:38.114 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:38.113569 18790 catalog_manager.cc:2511] T afce87139a9f488abb6963831b58cca9 reported cstate change: term changed from 0 to 1, leader changed from to f6712fb9e95d482d881d3f8c58936d42 (127.70.237.1). New cstate: current_term: 1 leader_uuid: "f6712fb9e95d482d881d3f8c58936d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3f9940e383340d9b9cf3adbabf5612d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "f6712fb9e95d482d881d3f8c58936d42" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "b5851213ca55407284d76a9cea74db72" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } } 03:46:38.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.110136 21115 raft_consensus.cc:1971] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate b5851213ca55407284d76a9cea74db72 for term 1 because replica is either leader or believes a valid leader to be alive. 03:46:38.119 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.111735 21252 raft_consensus.cc:2456] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72: Snoozing failure detection for 1.866s (election complete) 03:46:38.119 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.111793 21252 raft_consensus.cc:2508] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 0 FOLLOWER]: Advancing to term 1 03:46:38.125 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.125382 21252 raft_consensus.cc:2216] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority 03:46:38.366 [DEBUG - Time-limited test] (AsyncKuduClient.java:1727) Learned about tablet afce87139a9f488abb6963831b58cca9 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:38.366 [DEBUG - Time-limited test] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=afce87139a9f488abb6963831b58cca9, ttl=299999}] 03:46:38.389 [DEBUG - Hashed wheel timer #2] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6c2cf2b4, flushNotification=Deferred@690909525(state=PENDING, result=null, callback=, errback=)} 03:46:38.453 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:38.453346 21001 raft_consensus.cc:964] T afce87139a9f488abb6963831b58cca9 P b5851213ca55407284d76a9cea74db72 [term 1 FOLLOWER]: Refusing update from remote peer f6712fb9e95d482d881d3f8c58936d42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:38.454 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.454468 21569 consensus_queue.cc:741] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [LEADER]: Connected to new peer: Peer: b5851213ca55407284d76a9cea74db72, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:38.458 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:38.458118 20868 raft_consensus.cc:964] T afce87139a9f488abb6963831b58cca9 P a3f9940e383340d9b9cf3adbabf5612d [term 1 FOLLOWER]: Refusing update from remote peer f6712fb9e95d482d881d3f8c58936d42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:38.459 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:38.459040 21569 consensus_queue.cc:741] T afce87139a9f488abb6963831b58cca9 P f6712fb9e95d482d881d3f8c58936d42 [LEADER]: Connected to new peer: Peer: a3f9940e383340d9b9cf3adbabf5612d, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:38.509 [DEBUG - Hashed wheel timer #2] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@184d1906, flushNotification=Deferred@335536617(state=PENDING, result=null, callback=, errback=)} 03:46:38.512 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:950) Notify RPC Batch{operations=1, tablet="c44211462fbc43959f0265b9662f4f5c" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=null, attempt=1, DeadlineTracker(timeout=30000, elapsed=3), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [3ms] Sub rpc: GetTableLocations received from server response Not found: The table was deleted: Table deleted at 2017-09-18 03:46:37 UTC (error 0), Deferred@1187766732(state=PENDING, result=null, callback=apply batch response, errback=apply batch error response))} after lookup exception org.apache.kudu.client.NonRecoverableException: The table was deleted: Table deleted at 2017-09-18 03:46:37 UTC at org.apache.kudu.client.RpcProxy.dispatchMasterError(RpcProxy.java:360) at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:253) at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:60) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:132) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:128) at org.apache.kudu.client.Connection.messageReceived(Connection.java:375) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.Connection.handleUpstream(Connection.java:239) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.handler.timeout.ReadTimeoutHandler.messageReceived(ReadTimeoutHandler.java:184) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 03:46:38.749 [DEBUG - Hashed wheel timer #2] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=2, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@49018e1a, flushNotification=Deferred@336782984(state=PENDING, result=null, callback=, errback=)} 03:46:38.968 [DEBUG - New I/O worker #69] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:46:38.976 [DEBUG - New I/O worker #75] (Connection.java:666) [peer b5851213ca55407284d76a9cea74db72] cleaning up while in state READY due to: connection disconnected 03:46:38.978 [DEBUG - New I/O worker #66] (Connection.java:666) [peer master-127.70.237.1:64030] cleaning up while in state READY due to: connection disconnected 03:46:38.980 [DEBUG - New I/O worker #76] (Connection.java:666) [peer f6712fb9e95d482d881d3f8c58936d42] cleaning up while in state READY due to: connection disconnected 03:46:38.982 [DEBUG - main] (Deferred.java:1330) callback=disconnect callback@1436664465 returned Deferred@558187323(state=PENDING, result=null, callback=release resources callback -> (continuation of Deferred@680576081 after disconnect callback@1436664465), errback=passthrough -> (continuation of Deferred@680576081 after disconnect callback@1436664465)), so the following Deferred is getting paused: Deferred@680576081(state=PAUSED, result=Deferred@558187323, callback=, errback=) 03:46:38.984 [DEBUG - New I/O worker #67] (Connection.java:666) [peer master-127.70.237.1:64032] cleaning up while in state READY due to: connection disconnected 03:46:38.985 [DEBUG - New I/O worker #68] (AsyncKuduClient.java:1872) Releasing all remaining resources 03:46:39.012 [DEBUG - New I/O worker #68] (Connection.java:666) [peer master-127.70.237.1:64034] cleaning up while in state READY due to: connection disconnected 03:46:39.045 [DEBUG - New I/O worker #2] (Connection.java:666) [peer master-127.70.237.1:64032] cleaning up while in state READY due to: connection disconnected 03:46:39.059 [DEBUG - New I/O worker #4] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:46:39.060 [DEBUG - New I/O worker #3] (Connection.java:666) [peer master-127.70.237.1:64034] cleaning up while in state READY due to: connection disconnected 03:46:39.064 [DEBUG - New I/O worker #1] (Connection.java:666) [peer master-127.70.237.1:64030] cleaning up while in state READY due to: connection disconnected 03:46:39.095 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) *** Aborted at 1505706399 (unix time) try "date -d @1505706399" if you are using GNU date *** 03:46:39.095 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) PC: @ 0x7fe799032d4d nanosleep 03:46:39.095 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) *** SIGTERM (@0x3e8000046ed) received by PID 20631 (TID 0x7fe79b7fc880) from PID 18157; stack trace: *** 03:46:39.095 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7fe798fa4cb0 (unknown) 03:46:39.095 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7fe799032d4d nanosleep 03:46:39.095 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7fe799b1da17 base::SleepForNanoseconds() 03:46:39.095 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7fe79a6c1bc1 kudu::SleepFor() 03:46:39.096 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x404a3f kudu::tserver::TabletServerMain() 03:46:39.096 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x404be0 main 03:46:39.096 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7fe798f8ff45 __libc_start_main 03:46:39.096 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x4042e9 (unknown) 03:46:39.096 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x0 (unknown) 03:46:39.112 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) *** Aborted at 1505706399 (unix time) try "date -d @1505706399" if you are using GNU date *** 03:46:39.112 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) PC: @ 0x7f9ed2921d4d nanosleep 03:46:39.112 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) *** SIGTERM (@0x3e8000046ed) received by PID 20726 (TID 0x7f9ed50eb880) from PID 18157; stack trace: *** 03:46:39.112 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7f9ed2893cb0 (unknown) 03:46:39.112 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7f9ed2921d4d nanosleep 03:46:39.112 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7f9ed340ca17 base::SleepForNanoseconds() 03:46:39.311 [INFO - main] (BaseKuduTest.java:75) Setting up before class... 03:46:39.312 [INFO - main] (MiniKuduCluster.java:152) Starting 3 masters... 03:46:39.498 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:39.508 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:39.497998 22112 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:39.510 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:39.510694 22112 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:39.511 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:39.511004 22112 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:39.511 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:39.511180 22112 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:39.511 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:39.511358 22112 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.513449 22112 master_main.cc:66] Master server non-default flags: 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706399313/data 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706399313/data 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:39.513 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64030 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_port=64031 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --never_fsync=true 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.22112 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706399313/logs 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --logtostderr=true 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Master server version: 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build type DEBUG 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:39.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build id 9998 03:46:39.522 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.522424 22112 minidump.cc:237] Setting minidump size limit to 20M 03:46:39.609 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.609149 22112 master_main.cc:73] Initializing master server... 03:46:39.610 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.609985 22112 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 443829 03:46:39.619 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.619848 22112 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706399313/data/instance: No such file or directory (error 2) 03:46:39.620 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.619899 22112 server_base.cc:229] Creating new FS layout 03:46:39.624 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.624737 22112 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706399313/data/instance: 03:46:39.625 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "d6a0f3a07b7e4765b916cd42b8972268" 03:46:39.625 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:39 on jenkins-slave-c3oe" 03:46:39.635 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.635282 22112 fs_manager.cc:431] Time spent creating directory manager: real 0.010s user 0.004s sys 0.000s 03:46:39.636 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.636245 22112 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:39.636 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.636741 22112 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:39.666 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.665948 22112 fs_manager.cc:335] Time spent opening block manager: real 0.027s user 0.000s sys 0.004s 03:46:39.666 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.666532 22112 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706399313/data 03:46:39.666 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "d6a0f3a07b7e4765b916cd42b8972268" 03:46:39.666 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:39 on jenkins-slave-c3oe" 03:46:39.670 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.670804 22112 fs_report.cc:347] Block manager report 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) -------------------- 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706399313/data/data 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:39.671 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.813123 22112 master_main.cc:76] Starting Master server... 03:46:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.813446 22217 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.813465 22217 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:39.813472 22217 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:39.825 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:39.825 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:39.825256 22186 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:39.827 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:39.826946 22186 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:39.827 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:39.826993 22186 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:39.827 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:39.827003 22186 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:39.827 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:39.827050 22186 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:39.829 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.829866 22186 master_main.cc:66] Master server non-default flags: 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706399313/data 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706399313/data 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64032 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_port=64033 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --never_fsync=true 03:46:39.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.22186 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706399313/logs 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --logtostderr=true 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Master server version: 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build type DEBUG 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:39.831 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build id 9998 03:46:39.849 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.849799 22186 minidump.cc:237] Setting minidump size limit to 20M 03:46:39.891 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.891000 22186 master_main.cc:73] Initializing master server... 03:46:39.891 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.891789 22186 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 443829 03:46:39.905 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.905625 22186 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706399313/data/instance: No such file or directory (error 2) 03:46:39.906 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.905666 22186 server_base.cc:229] Creating new FS layout 03:46:39.910 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.909914 22186 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706399313/data/instance: 03:46:39.910 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" 03:46:39.910 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:39 on jenkins-slave-c3oe" 03:46:39.969 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.969774 22186 fs_manager.cc:431] Time spent creating directory manager: real 0.060s user 0.008s sys 0.000s 03:46:39.970 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.970432 22186 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:39.970 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.970646 22186 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:39.984 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.978165 22186 fs_manager.cc:335] Time spent opening block manager: real 0.005s user 0.000s sys 0.000s 03:46:39.984 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.978302 22186 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706399313/data 03:46:39.984 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" 03:46:39.984 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:39 on jenkins-slave-c3oe" 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:39.978366 22186 fs_report.cc:347] Block manager report 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) -------------------- 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706399313/data/data 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:39.985 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:40.105 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:40.106 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:40.105629 22288 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:40.107 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:40.107002 22288 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:40.107 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:40.107038 22288 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:40.107 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:40.107048 22288 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:40.107 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:40.107074 22288 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:40.108 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.108871 22288 master_main.cc:66] Master server non-default flags: 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706399313/data 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706399313/data 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64034 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_port=64035 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --never_fsync=true 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.22288 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706399313/logs 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --logtostderr=true 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Master server version: 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:40.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:40.110 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build type DEBUG 03:46:40.110 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:40.110 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build id 9998 03:46:40.138 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.138710 22288 minidump.cc:237] Setting minidump size limit to 20M 03:46:40.186 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.186051 22186 master_main.cc:76] Starting Master server... 03:46:40.196 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.196789 22363 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:40.197 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.197199 22363 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:40.197 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.197388 22363 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:40.212 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.212672 22288 master_main.cc:73] Initializing master server... 03:46:40.213 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.213770 22288 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 444329 03:46:40.228 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.225167 22288 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706399313/data/instance: No such file or directory (error 2) 03:46:40.228 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.225210 22288 server_base.cc:229] Creating new FS layout 03:46:40.230 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.230262 22288 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706399313/data/instance: 03:46:40.230 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "367c809421b54dd788ac884904e5abc5" 03:46:40.230 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:40 on jenkins-slave-c3oe" 03:46:40.252 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.252660 22112 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64030 03:46:40.253 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.253458 22112 webserver.cc:149] Starting webserver on 127.70.237.1:64031 03:46:40.253 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.253648 22112 webserver.cc:160] Document root disabled 03:46:40.254 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.254294 22112 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64031/ 03:46:40.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.265874 22288 fs_manager.cc:431] Time spent creating directory manager: real 0.035s user 0.004s sys 0.000s 03:46:40.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.266815 22288 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:40.267 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.267223 22288 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:40.275 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.275842 22389 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.277 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.277750 22288 fs_manager.cc:335] Time spent opening block manager: real 0.008s user 0.004s sys 0.000s 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.278123 22288 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706399313/data 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "367c809421b54dd788ac884904e5abc5" 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:40 on jenkins-slave-c3oe" 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.278489 22288 fs_report.cc:347] Block manager report 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) -------------------- 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706399313/data/data 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:40.278 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:40.279 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:40.279 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:40.279 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:40.279 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:40.279 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:40.312 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.312461 22389 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.314 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:40.314276 22389 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:40.349 [INFO - main] (MiniKuduCluster.java:155) Starting 3 tablet servers... 03:46:40.362 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.362571 22389 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 1 03:46:40.364 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:40.364054 22389 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:40.409 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.409188 22288 master_main.cc:76] Starting Master server... 03:46:40.424 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.424680 22434 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:40.425 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.425101 22434 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:40.425 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.425285 22434 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:40.426 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.426239 22389 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 2 03:46:40.427 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:40.427567 22389 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:40.460 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:40.460 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:40.460160 22413 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:40.461 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:40.461398 22413 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:40.461 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:40.461443 22413 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:40.461 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:40.461468 22413 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.463201 22413 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706400349/data 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706400349/data 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64036 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.22413 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:40.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:40.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706400349/logs 03:46:40.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 03:46:40.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 03:46:40.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:40.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:40.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type DEBUG 03:46:40.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:40.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 9998 03:46:40.494 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.494742 22389 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 3 03:46:40.495 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:40.495538 22389 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:40.589 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.588605 22413 minidump.cc:237] Setting minidump size limit to 20M 03:46:40.628 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.628698 22413 tablet_server_main.cc:79] Initializing tablet server... 03:46:40.630 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.629981 22413 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 444329 03:46:40.655 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.655479 22288 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64034 03:46:40.655 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.655863 22288 webserver.cc:149] Starting webserver on 127.70.237.1:64035 03:46:40.655 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.655880 22288 webserver.cc:160] Document root disabled 03:46:40.656 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.656306 22288 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64035/ 03:46:40.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.659715 22389 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 4 03:46:40.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:40.660524 22389 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:40.663 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.663446 22551 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.665256 22186 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64032 03:46:40.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.665596 22186 webserver.cc:149] Starting webserver on 127.70.237.1:64033 03:46:40.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.665616 22186 webserver.cc:160] Document root disabled 03:46:40.666 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.666044 22186 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64033/ 03:46:40.672 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.672888 22563 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.680 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.680251 22551 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.690 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.690381 22563 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.697 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.697535 22413 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706400349/data/instance: No such file or directory (error 2) 03:46:40.697 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.697831 22413 server_base.cc:229] Creating new FS layout 03:46:40.702 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.701988 22413 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706400349/data/instance: 03:46:40.702 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" 03:46:40.702 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:40 on jenkins-slave-c3oe" 03:46:40.706 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.706305 22563 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.706 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.706308 22551 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.717 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.717653 22413 fs_manager.cc:431] Time spent creating directory manager: real 0.015s user 0.008s sys 0.000s 03:46:40.718 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.718178 22413 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:40.718 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.718376 22413 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:40.752 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.749197 22551 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5: Bootstrap starting. 03:46:40.752 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.751186 22551 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5: No blocks or log segments found. Creating new log. 03:46:40.752 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.751956 22551 log.cc:518] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5: Log is configured to *not* fsync() on all Append() calls 03:46:40.754 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:40.754 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:40.754416 22554 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:40.755 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:40.755878 22554 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:40.756 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:40.756083 22554 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:40.756 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:40.756259 22554 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.749699 22413 fs_manager.cc:335] Time spent opening block manager: real 0.029s user 0.004s sys 0.000s 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.749842 22413 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706400349/data 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:40 on jenkins-slave-c3oe" 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.749900 22413 fs_report.cc:347] Block manager report 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706400349/data/data 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:40.756 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:40.757 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:40.757 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:40.757 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:40.757 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:40.757 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:40.757 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:40.757 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.758103 22554 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706400349/data 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706400349/data 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64038 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.22554 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:40.758 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:40.759 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706400349/logs 03:46:40.759 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 03:46:40.759 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 03:46:40.759 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:40.759 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:40.759 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type DEBUG 03:46:40.759 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:40.759 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 9998 03:46:40.760 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.760697 22551 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5: No bootstrap required, opened a new log 03:46:40.762 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.762383 22551 raft_consensus.cc:287] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:40.762 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.762632 22551 raft_consensus.cc:313] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:40.763 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.762981 22551 raft_consensus.cc:576] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367c809421b54dd788ac884904e5abc5, State: Initialized, Role: FOLLOWER 03:46:40.763 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.763218 22551 consensus_queue.cc:190] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:40.763 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.763701 22551 sys_catalog.cc:321] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:40.763 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.763880 22551 sys_catalog.cc:324] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: This master's current role is: FOLLOWER 03:46:40.764 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.764734 22551 sys_catalog.cc:408] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: configured and running, proceeding with master startup. 03:46:40.765 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.763757 22594 sys_catalog.cc:321] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:40.765 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.765126 22595 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 03:46:40.765 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.765189 22594 sys_catalog.cc:324] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: This master's current role is: FOLLOWER 03:46:40.765 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.765625 22288 master_main.cc:79] Master server successfully started. 03:46:40.778 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.776314 22563 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: Bootstrap starting. 03:46:40.779 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.778151 22563 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: No blocks or log segments found. Creating new log. 03:46:40.779 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.778795 22563 log.cc:518] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: Log is configured to *not* fsync() on all Append() calls 03:46:40.780 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.780395 22563 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: No bootstrap required, opened a new log 03:46:40.782 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.782269 22563 raft_consensus.cc:287] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:40.782 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.782515 22563 raft_consensus.cc:313] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:40.782 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.782927 22563 raft_consensus.cc:576] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d83fb3ca98e491db46d4722c2e9dd6d, State: Initialized, Role: FOLLOWER 03:46:40.783 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.783164 22563 consensus_queue.cc:190] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:40.796 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.796842 22563 sys_catalog.cc:321] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:40.797 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.797148 22563 sys_catalog.cc:324] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [sys.catalog]: This master's current role is: FOLLOWER 03:46:40.798 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.798105 22563 sys_catalog.cc:408] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [sys.catalog]: configured and running, proceeding with master startup. 03:46:40.798 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.798820 22600 sys_catalog.cc:321] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:40.799 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.799008 22600 sys_catalog.cc:324] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [sys.catalog]: This master's current role is: FOLLOWER 03:46:40.804 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.804714 22186 master_main.cc:79] Master server successfully started. 03:46:40.808 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.808243 22554 minidump.cc:237] Setting minidump size limit to 20M 03:46:40.813 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.813683 22600 raft_consensus.cc:412] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:40.814 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.814038 22600 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: Snoozing failure detection for 0.706s (starting election) 03:46:40.814 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.814347 22600 raft_consensus.cc:434] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:40.815 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.815201 22600 leader_election.cc:221] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer d6a0f3a07b7e4765b916cd42b8972268 03:46:40.815 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.815934 22600 leader_election.cc:221] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 367c809421b54dd788ac884904e5abc5 03:46:40.818 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.817541 22528 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367c809421b54dd788ac884904e5abc5" is_pre_election: true 03:46:40.818 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.817744 22528 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5: Snoozing failure detection for 0.846s (vote granted) 03:46:40.818 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.817787 22528 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d83fb3ca98e491db46d4722c2e9dd6d in term 0. 03:46:40.818 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.818492 22293 leader_election.cc:353] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 pre-election: Vote granted by peer 367c809421b54dd788ac884904e5abc5 03:46:40.818 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.818531 22293 leader_election.cc:248] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:40.819 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.819177 22600 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: Snoozing failure detection for 0.653s (election complete) 03:46:40.821 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.821380 22600 raft_consensus.cc:2280] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:40.821 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.821606 22600 raft_consensus.cc:412] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:40.821 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.821776 22600 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: Snoozing failure detection for 0.648s (starting election) 03:46:40.821 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.821902 22600 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 0 FOLLOWER]: Advancing to term 1 03:46:40.823 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.823060 22600 raft_consensus.cc:434] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:40.823 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.823565 22600 leader_election.cc:221] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 election: Requesting vote from peer d6a0f3a07b7e4765b916cd42b8972268 03:46:40.824 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.824383 22600 leader_election.cc:221] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 election: Requesting vote from peer 367c809421b54dd788ac884904e5abc5 03:46:40.825 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.825126 22528 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367c809421b54dd788ac884904e5abc5" 03:46:40.825 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.825212 22528 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [term 0 FOLLOWER]: Advancing to term 1 03:46:40.825 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.825294 22528 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5: Snoozing failure detection for 0.637s (vote granted) 03:46:40.829 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:40.829439 22528 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d83fb3ca98e491db46d4722c2e9dd6d in term 1. 03:46:40.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.830109 22293 leader_election.cc:353] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 election: Vote granted by peer 367c809421b54dd788ac884904e5abc5 03:46:40.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.830149 22293 leader_election.cc:248] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:40.835 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.835711 22600 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: Snoozing failure detection for 0.716s (election complete) 03:46:40.836 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.836086 22600 raft_consensus.cc:2280] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 1 FOLLOWER]: Leader election won for term 1 03:46:40.836 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.836403 22600 raft_consensus.cc:542] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [term 1 LEADER]: Becoming Leader. State: Replica: 4d83fb3ca98e491db46d4722c2e9dd6d, State: Running, Role: LEADER 03:46:40.836 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.836937 22600 consensus_queue.cc:169] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:40.844 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.844723 22554 tablet_server_main.cc:79] Initializing tablet server... 03:46:40.845 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.845759 22554 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 444329 03:46:40.847 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.847324 22413 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:40.856 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:40.856595 22413 tablet_server_main.cc:84] Starting tablet server... 03:46:40.862 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.862040 22613 sys_catalog.cc:321] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d83fb3ca98e491db46d4722c2e9dd6d. Latest consensus state: current_term: 1 leader_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:40.862 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.862418 22613 sys_catalog.cc:324] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [sys.catalog]: This master's current role is: LEADER 03:46:40.877 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.877707 22622 catalog_manager.cc:948] Loading table and tablet metadata into memory... 03:46:40.905 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.905014 22554 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706400349/data/instance: No such file or directory (error 2) 03:46:40.905 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.905504 22554 server_base.cc:229] Creating new FS layout 03:46:40.912 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:40.912703 22622 catalog_manager.cc:959] Initializing Kudu internal certificate authority... 03:46:40.926 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.926110 22554 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706400349/data/instance: 03:46:40.926 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "47e1da97776b4cd7a761f7ba221fe099" 03:46:40.926 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:40 on jenkins-slave-c3oe" 03:46:40.937 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.937803 22554 fs_manager.cc:431] Time spent creating directory manager: real 0.011s user 0.000s sys 0.004s 03:46:40.938 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.938802 22554 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:40.939 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:40.939297 22554 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:40.940 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.940698 22389 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 5 03:46:40.960 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.959336 22389 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:40.970 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.967085 22389 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268: Bootstrap starting. 03:46:40.970 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.969061 22389 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268: No blocks or log segments found. Creating new log. 03:46:40.970 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.969820 22389 log.cc:518] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268: Log is configured to *not* fsync() on all Append() calls 03:46:40.980 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.980386 22389 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268: No bootstrap required, opened a new log 03:46:40.982 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.982281 22389 raft_consensus.cc:287] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:40.982 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.982836 22389 raft_consensus.cc:313] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:40.983 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.983286 22389 raft_consensus.cc:576] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6a0f3a07b7e4765b916cd42b8972268, State: Initialized, Role: FOLLOWER 03:46:40.983 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:40.983551 22389 consensus_queue.cc:190] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:41.005 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.005013 22389 sys_catalog.cc:321] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:41.005 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.005652 22389 sys_catalog.cc:324] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: This master's current role is: FOLLOWER 03:46:41.007 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.007072 22643 sys_catalog.cc:321] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:41.007 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.007390 22643 sys_catalog.cc:324] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: This master's current role is: FOLLOWER 03:46:41.008 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.008375 22389 sys_catalog.cc:408] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: configured and running, proceeding with master startup. 03:46:41.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.009490 22294 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6a0f3a07b7e4765b916cd42b8972268" is_pre_election: true 03:46:41.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.009508 22285 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6a0f3a07b7e4765b916cd42b8972268" 03:46:41.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.009696 22285 raft_consensus.cc:2508] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [term 0 FOLLOWER]: Advancing to term 1 03:46:41.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.009835 22285 raft_consensus.cc:2456] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268: Snoozing failure detection for 0.676s (vote granted) 03:46:41.010 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.010932 22285 raft_consensus.cc:2010] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d83fb3ca98e491db46d4722c2e9dd6d in term 1. 03:46:41.012 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.011466 22294 raft_consensus.cc:1985] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d83fb3ca98e491db46d4722c2e9dd6d for term 1 because replica is already servicing an update from a current leader or another vote. 03:46:41.025 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.025315 22554 fs_manager.cc:335] Time spent opening block manager: real 0.083s user 0.000s sys 0.004s 03:46:41.025 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.025838 22554 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706400349/data 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "47e1da97776b4cd7a761f7ba221fe099" 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:40 on jenkins-slave-c3oe" 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.026322 22554 fs_report.cc:347] Block manager report 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706400349/data/data 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:41.027 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:41.027 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:41.027 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:41.028 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.028770 22112 master_main.cc:79] Master server successfully started. 03:46:41.041 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.040894 22287 leader_election.cc:353] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 election: Vote granted by peer d6a0f3a07b7e4765b916cd42b8972268 03:46:41.042 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.041357 22287 leader_election.cc:367] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [CANDIDATE]: Term 1 pre-election: Vote denied by peer d6a0f3a07b7e4765b916cd42b8972268. Message: Service unavailable: T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d83fb3ca98e491db46d4722c2e9dd6d for term 1 because replica is already servicing an update from a current leader or another vote. 03:46:41.042 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.042659 22285 raft_consensus.cc:964] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [term 1 FOLLOWER]: Refusing update from remote peer 4d83fb3ca98e491db46d4722c2e9dd6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:41.043 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:41.043090 22528 raft_consensus.cc:964] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [term 1 FOLLOWER]: Refusing update from remote peer 4d83fb3ca98e491db46d4722c2e9dd6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:41.043 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.043650 22613 consensus_queue.cc:741] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [LEADER]: Connected to new peer: Peer: d6a0f3a07b7e4765b916cd42b8972268, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:41.044 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.043993 22647 consensus_queue.cc:741] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d [LEADER]: Connected to new peer: Peer: 367c809421b54dd788ac884904e5abc5, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:41.057 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.057224 22643 sys_catalog.cc:321] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d83fb3ca98e491db46d4722c2e9dd6d. Latest consensus state: current_term: 1 leader_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:41.058 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.058002 22643 sys_catalog.cc:324] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: This master's current role is: FOLLOWER 03:46:41.067 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.067631 22643 sys_catalog.cc:321] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:41.068 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.068107 22643 sys_catalog.cc:324] T 00000000000000000000000000000000 P d6a0f3a07b7e4765b916cd42b8972268 [sys.catalog]: This master's current role is: FOLLOWER 03:46:41.070 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:41.070708 22594 sys_catalog.cc:321] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d83fb3ca98e491db46d4722c2e9dd6d. Latest consensus state: current_term: 1 leader_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:41.071 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:41.070746 22594 sys_catalog.cc:324] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: This master's current role is: FOLLOWER 03:46:41.082 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.078922 22622 catalog_manager.cc:846] Generated new certificate authority record 03:46:41.083 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.080256 22622 catalog_manager.cc:968] Loading token signing keys... 03:46:41.085 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:41.084966 22594 sys_catalog.cc:321] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a0f3a07b7e4765b916cd42b8972268" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "4d83fb3ca98e491db46d4722c2e9dd6d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "367c809421b54dd788ac884904e5abc5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:41.085 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:41.085012 22594 sys_catalog.cc:324] T 00000000000000000000000000000000 P 367c809421b54dd788ac884904e5abc5 [sys.catalog]: This master's current role is: FOLLOWER 03:46:41.099 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.099779 22622 catalog_manager.cc:3544] T 00000000000000000000000000000000 P 4d83fb3ca98e491db46d4722c2e9dd6d: Generated new TSK 0 03:46:41.115 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:41.116 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:41.115627 22653 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:41.116 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:41.116892 22653 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:41.117 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:41.117133 22653 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:41.117 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:41.117311 22653 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.119352 22653 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706400349/data 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706400349/data 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64040 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 03:46:41.119 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.22653 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706400349/logs 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 03:46:41.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 03:46:41.121 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:41.121 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:41.121 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type DEBUG 03:46:41.121 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:41.121 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 9998 03:46:41.167 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.167567 22554 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:41.169 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.168146 22554 tablet_server_main.cc:84] Starting tablet server... 03:46:41.228 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.228227 22413 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64036 03:46:41.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.229092 22413 webserver.cc:149] Starting webserver on 127.70.237.1:64037 03:46:41.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.229414 22413 webserver.cc:160] Document root disabled 03:46:41.230 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.230206 22413 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64037/ 03:46:41.234 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.234251 22413 tablet_server_main.cc:87] Tablet server successfully started. 03:46:41.234 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.234103 22824 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:41.234 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.234752 22824 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:41.234 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.234869 22824 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:41.257 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.257843 22653 minidump.cc:237] Setting minidump size limit to 20M 03:46:41.285 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.284344 22820 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:41.285 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.284544 22820 heartbeater.cc:387] Registering TS with master... 03:46:41.285 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.284974 22820 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:41.288 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.286892 22410 ts_manager.cc:81] Registered new tserver with Master: a8b7ee72e4d245d2a2710ab6ee79ec7d (127.70.237.1:64036) 03:46:41.289 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.288410 22410 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:39873 03:46:41.291 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:41.291123 22482 ts_manager.cc:81] Registered new tserver with Master: a8b7ee72e4d245d2a2710ab6ee79ec7d (127.70.237.1:64036) 03:46:41.291 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.291411 22257 ts_manager.cc:81] Registered new tserver with Master: a8b7ee72e4d245d2a2710ab6ee79ec7d (127.70.237.1:64036) 03:46:41.291 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.289948 22823 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:41.292 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.289999 22823 heartbeater.cc:387] Registering TS with master... 03:46:41.292 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.290165 22823 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:41.292 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.290336 22819 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:41.292 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.290385 22819 heartbeater.cc:387] Registering TS with master... 03:46:41.292 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:41.290525 22819 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:41.300 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.300809 22653 tablet_server_main.cc:79] Initializing tablet server... 03:46:41.301 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.301689 22653 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 444829 03:46:41.319 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.319165 22653 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706400349/data/instance: No such file or directory (error 2) 03:46:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.319535 22653 server_base.cc:229] Creating new FS layout 03:46:41.323 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.323886 22653 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706400349/data/instance: 03:46:41.324 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "9e820884ca0b45fbbbd865f9dafc2d04" 03:46:41.324 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:41 on jenkins-slave-c3oe" 03:46:41.354 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.354115 22653 fs_manager.cc:431] Time spent creating directory manager: real 0.030s user 0.012s sys 0.000s 03:46:41.355 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.355321 22653 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:41.355 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.355726 22653 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:41.359 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.359689 22653 fs_manager.cc:335] Time spent opening block manager: real 0.001s user 0.000s sys 0.004s 03:46:41.359 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.359877 22653 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706400349/data 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "9e820884ca0b45fbbbd865f9dafc2d04" 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:41 on jenkins-slave-c3oe" 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.359954 22653 fs_report.cc:347] Block manager report 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706400349/data/data 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:41.360 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:41.362 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:41.362 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:41.362 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:41.362 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:41.361 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 03:46:41.412 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.412607 22653 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:41.413 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.413292 22653 tablet_server_main.cc:84] Starting tablet server... 03:46:41.425 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.425367 22554 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64038 03:46:41.426 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.426184 22554 webserver.cc:149] Starting webserver on 127.70.237.1:64039 03:46:41.426 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.426484 22554 webserver.cc:160] Document root disabled 03:46:41.427 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.427268 22554 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64039/ 03:46:41.445 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.445025 22554 tablet_server_main.cc:87] Tablet server successfully started. 03:46:41.445 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.444912 23079 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:41.445 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.445479 23079 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:41.445 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.445490 23079 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:41.466 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.466497 22653 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64040 03:46:41.467 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.467308 22653 webserver.cc:149] Starting webserver on 127.70.237.1:64041 03:46:41.467 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.466511 22999 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:41.467 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.466691 22999 heartbeater.cc:387] Registering TS with master... 03:46:41.467 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.467142 22999 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:41.467 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.467814 22653 webserver.cc:160] Document root disabled 03:46:41.468 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.468549 22653 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64041/ 03:46:41.469 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.468114 22410 ts_manager.cc:81] Registered new tserver with Master: 47e1da97776b4cd7a761f7ba221fe099 (127.70.237.1:64038) 03:46:41.469 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.469039 22410 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:39219 03:46:41.477 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.477049 22998 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:41.477 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.477133 22998 heartbeater.cc:387] Registering TS with master... 03:46:41.477 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.477331 22998 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:41.478 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.478070 22257 ts_manager.cc:81] Registered new tserver with Master: 47e1da97776b4cd7a761f7ba221fe099 (127.70.237.1:64038) 03:46:41.484 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.484194 23000 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:41.484 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.484259 23000 heartbeater.cc:387] Registering TS with master... 03:46:41.484 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:41.484388 23000 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:41.485 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:41.485626 22482 ts_manager.cc:81] Registered new tserver with Master: 47e1da97776b4cd7a761f7ba221fe099 (127.70.237.1:64038) 03:46:41.489 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.489365 22653 tablet_server_main.cc:87] Tablet server successfully started. 03:46:41.489 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.489292 23119 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:41.489 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.489790 23119 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:41.489 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.489926 23119 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:41.511 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.511154 23113 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:41.511 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.511795 23113 heartbeater.cc:387] Registering TS with master... 03:46:41.512 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.512559 23113 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:41.514 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:41.513912 22257 ts_manager.cc:81] Registered new tserver with Master: 9e820884ca0b45fbbbd865f9dafc2d04 (127.70.237.1:64040) 03:46:41.527 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.526590 23114 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:41.527 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.526657 23114 heartbeater.cc:387] Registering TS with master... 03:46:41.527 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.526846 23114 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:41.527 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.527037 23118 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:41.527 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.527077 23118 heartbeater.cc:387] Registering TS with master... 03:46:41.527 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:41.527196 23118 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:41.528 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:41.527842 22482 ts_manager.cc:81] Registered new tserver with Master: 9e820884ca0b45fbbbd865f9dafc2d04 (127.70.237.1:64040) 03:46:41.529 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.528172 22410 ts_manager.cc:81] Registered new tserver with Master: 9e820884ca0b45fbbbd865f9dafc2d04 (127.70.237.1:64040) 03:46:41.529 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:41.529058 22410 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:60968 03:46:41.561 [INFO - main] (BaseKuduTest.java:117) Creating new Kudu client... 03:46:41.562 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 03:46:41.768 [INFO - main] (BaseKuduTest.java:123) Waiting for tablet servers... 03:46:41.978 [DEBUG - New I/O worker #131] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:41.978 [DEBUG - New I/O worker #133] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:41.978 [DEBUG - New I/O worker #132] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:42.010 [DEBUG - New I/O worker #132] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 03:46:42.011 [DEBUG - New I/O worker #132] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=42), Traces: [0ms] querying master, [1ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64030, [2ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64032, [2ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64034, [37ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64034 response OK, [41ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64032 response OK, [42ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64030 response OK, null) after lookup 03:46:42.021 [DEBUG - New I/O worker #132] (Deferred.java:1330) callback=retry RPC@1197570691 returned Deferred@324063459(state=PENDING, result=null, callback=(continuation of Deferred@1995225985 after retry RPC@1197570691), errback=(continuation of Deferred@1995225985 after retry RPC@1197570691)), so the following Deferred is getting paused: Deferred@1995225985(state=PAUSED, result=Deferred@324063459, callback=wakeup thread main, errback=wakeup thread main) 03:46:42.055 [INFO - main] (BaseKuduTest.java:131) Creating table: org.apache.kudu.client.TestAsyncKuduSession-1505706385081 03:46:42.082 [DEBUG - New I/O worker #196] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:42.085 [DEBUG - New I/O worker #197] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:42.091 [DEBUG - New I/O worker #198] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:42.134 [DEBUG - New I/O worker #197] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 03:46:42.134 [DEBUG - New I/O worker #197] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=79), Traces: [0ms] querying master, [17ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64030, [18ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64032, [18ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64034, [75ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64034 response OK, [76ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64030 response OK, [78ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64032 response OK, null) after lookup 03:46:42.138 [DEBUG - New I/O worker #197] (Deferred.java:1330) callback=retry RPC@1152760436 returned Deferred@717251783(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after retry RPC@1152760436), errback=(continuation of Deferred@522616378 after retry RPC@1152760436)), so the following Deferred is getting paused: Deferred@522616378(state=PAUSED, result=Deferred@717251783, callback=org.apache.kudu.client.AsyncKuduClient$1@2974fb30 -> org.apache.kudu.client.AsyncKuduClient$2@40fb8270 -> wakeup thread main, errback=passthrough -> passthrough -> wakeup thread main) 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:42.170042 22410 catalog_manager.cc:1211] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:33205: 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) name: "org.apache.kudu.client.TestAsyncKuduSession-1505706385081" 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) schema { 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) columns { 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) name: "key" 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) type: INT32 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_key: true 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_nullable: false 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) columns { 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) name: "column1_i" 03:46:42.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) type: INT32 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_key: false 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_nullable: false 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) columns { 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) name: "column2_i" 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) type: INT32 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_key: false 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_nullable: false 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) columns { 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) name: "column3_s" 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) type: STRING 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_key: false 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_nullable: true 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) compression: LZ4 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) cfile_block_size: 4096 03:46:42.171 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) columns { 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) name: "column4_b" 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) type: BOOL 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_key: false 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) is_nullable: false 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) partition_schema { 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) range_schema { 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) columns { 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) name: "key" 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.172 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) } 03:46:42.212 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@2974fb30@695532336 returned Deferred@130176596(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@42c0d8c8 -> (continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$1@2974fb30@695532336), errback=passthrough -> (continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$1@2974fb30@695532336)), so the following Deferred is getting paused: Deferred@522616378(state=PAUSED, result=Deferred@130176596, callback=org.apache.kudu.client.AsyncKuduClient$2@40fb8270 -> wakeup thread main, errback=passthrough -> wakeup thread main) 03:46:42.213 [DEBUG - New I/O worker #199] (AsyncKuduClient.java:571) Opened table 89920386b10f4365b108d30acd72f9f4 03:46:42.215 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752)), so the following Deferred is getting paused: Deferred@522616378(state=PAUSED, result=Deferred@508501673, callback=wakeup thread main, errback=wakeup thread main) 03:46:42.238 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873)), so the following Deferred is getting paused: Deferred@1722656002(state=PAUSED, result=Deferred@508501673, callback=, errback=) 03:46:42.255 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567)), so the following Deferred is getting paused: Deferred@1144250149(state=PAUSED, result=Deferred@508501673, callback=, errback=) 03:46:42.265 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.265192 22698 tablet_service.cc:764] Processing CreateTablet for tablet e721bf7222df463b9b8ab9f032f01dbc (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=89920386b10f4365b108d30acd72f9f4]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:42.265 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.265175 23040 tablet_service.cc:764] Processing CreateTablet for tablet e721bf7222df463b9b8ab9f032f01dbc (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=89920386b10f4365b108d30acd72f9f4]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:42.269 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.265178 22869 tablet_service.cc:764] Processing CreateTablet for tablet e721bf7222df463b9b8ab9f032f01dbc (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=89920386b10f4365b108d30acd72f9f4]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:42.270 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.269673 22869 ts_tablet_manager.cc:948] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: Registered tablet (data state: TABLET_DATA_READY) 03:46:42.276 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263)), so the following Deferred is getting paused: Deferred@2108238572(state=PAUSED, result=Deferred@508501673, callback=, errback=) 03:46:42.287 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.287655 22698 ts_tablet_manager.cc:948] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: Registered tablet (data state: TABLET_DATA_READY) 03:46:42.288 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.288686 23239 ts_tablet_manager.cc:798] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: Bootstrapping tablet 03:46:42.289 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.289235 23239 tablet_bootstrap.cc:433] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: Bootstrap starting. 03:46:42.291 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.291296 23239 tablet_bootstrap.cc:568] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: No blocks or log segments found. Creating new log. 03:46:42.292 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.292335 23239 log.cc:518] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: Log is configured to *not* fsync() on all Append() calls 03:46:42.292 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.292517 23040 ts_tablet_manager.cc:948] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Registered tablet (data state: TABLET_DATA_READY) 03:46:42.293 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.293629 22820 heartbeater.cc:406] Master 127.70.237.1:64032 was elected leader, sending a full tablet report... 03:46:42.296 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441)), so the following Deferred is getting paused: Deferred@2083635399(state=PAUSED, result=Deferred@508501673, callback=, errback=) 03:46:42.301 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.301343 23238 ts_tablet_manager.cc:798] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: Bootstrapping tablet 03:46:42.301 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.301851 23238 tablet_bootstrap.cc:433] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: Bootstrap starting. 03:46:42.303 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.303730 23238 tablet_bootstrap.cc:568] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: No blocks or log segments found. Creating new log. 03:46:42.304 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.304709 23238 log.cc:518] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: Log is configured to *not* fsync() on all Append() calls 03:46:42.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.309664 23239 tablet_bootstrap.cc:433] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: No bootstrap required, opened a new log 03:46:42.310 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.310232 23239 ts_tablet_manager.cc:823] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.004s 03:46:42.312 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.312031 23239 raft_consensus.cc:287] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "47e1da97776b4cd7a761f7ba221fe099" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:42.312 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.312319 23239 raft_consensus.cc:313] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:42.312 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.312819 23239 raft_consensus.cc:576] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8b7ee72e4d245d2a2710ab6ee79ec7d, State: Initialized, Role: FOLLOWER 03:46:42.313 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.313091 23239 consensus_queue.cc:190] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:42.315 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441) -> (continuation of Deferred@104206923 after org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441) -> (continuation of Deferred@104206923 after org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386)), so the following Deferred is getting paused: Deferred@104206923(state=PAUSED, result=Deferred@508501673, callback=, errback=) 03:46:42.329 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.329533 23239 ts_tablet_manager.cc:851] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: Time spent starting tablet: real 0.019s user 0.000s sys 0.004s 03:46:42.331 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.328625 23241 ts_tablet_manager.cc:798] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Bootstrapping tablet 03:46:42.332 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.328970 23241 tablet_bootstrap.cc:433] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Bootstrap starting. 03:46:42.332 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.330883 23241 tablet_bootstrap.cc:568] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: No blocks or log segments found. Creating new log. 03:46:42.332 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.331704 23241 log.cc:518] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Log is configured to *not* fsync() on all Append() calls 03:46:42.333 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.333492 23238 tablet_bootstrap.cc:433] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: No bootstrap required, opened a new log 03:46:42.334 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.334020 23238 ts_tablet_manager.cc:823] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s 03:46:42.335 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.335682 23238 raft_consensus.cc:287] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "47e1da97776b4cd7a761f7ba221fe099" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:42.336 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.335980 23238 raft_consensus.cc:313] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:42.336 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.336478 23238 raft_consensus.cc:576] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47e1da97776b4cd7a761f7ba221fe099, State: Initialized, Role: FOLLOWER 03:46:42.336 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.336745 23238 consensus_queue.cc:190] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:42.342 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@2f709cbd@795909309 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441) -> (continuation of Deferred@104206923 after org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386) -> (continuation of Deferred@1572161132 after org.apache.kudu.client.AsyncKuduClient$12@2f709cbd@795909309), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441) -> (continuation of Deferred@104206923 after org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386) -> (continuation of Deferred@1572161132 after org.apache.kudu.client.AsyncKuduClient$12@2f709cbd@795909309)), so the following Deferred is getting paused: Deferred@1572161132(state=PAUSED, result=Deferred@508501673, callback=, errback=) 03:46:42.361 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.361332 22999 heartbeater.cc:406] Master 127.70.237.1:64032 was elected leader, sending a full tablet report... 03:46:42.365 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.365857 23238 ts_tablet_manager.cc:851] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: Time spent starting tablet: real 0.032s user 0.004s sys 0.000s 03:46:42.380 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.378412 23241 tablet_bootstrap.cc:433] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: No bootstrap required, opened a new log 03:46:42.381 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.378664 23241 ts_tablet_manager.cc:823] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.004s 03:46:42.381 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.380367 23241 raft_consensus.cc:287] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "47e1da97776b4cd7a761f7ba221fe099" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:42.381 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.380456 23241 raft_consensus.cc:313] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:42.381 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.380679 23241 raft_consensus.cc:576] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e820884ca0b45fbbbd865f9dafc2d04, State: Initialized, Role: FOLLOWER 03:46:42.381 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.380775 23241 consensus_queue.cc:190] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:42.387 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.385094 23241 ts_tablet_manager.cc:851] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s 03:46:42.388 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.385818 23114 heartbeater.cc:406] Master 127.70.237.1:64032 was elected leader, sending a full tablet report... 03:46:42.395 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@a1b84c8@169575624 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441) -> (continuation of Deferred@104206923 after org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386) -> (continuation of Deferred@1572161132 after org.apache.kudu.client.AsyncKuduClient$12@2f709cbd@795909309) -> (continuation of Deferred@1015643018 after org.apache.kudu.client.AsyncKuduClient$12@a1b84c8@169575624), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441) -> (continuation of Deferred@104206923 after org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386) -> (continuation of Deferred@1572161132 after org.apache.kudu.client.AsyncKuduClient$12@2f709cbd@795909309) -> (continuation of Deferred@1015643018 after org.apache.kudu.client.AsyncKuduClient$12@a1b84c8@169575624)), so the following Deferred is getting paused: Deferred@1015643018(state=PAUSED, result=Deferred@508501673, callback=, errback=) 03:46:42.454 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@17378dd2@389516754 returned Deferred@508501673(state=PENDING, result=null, callback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441) -> (continuation of Deferred@104206923 after org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386) -> (continuation of Deferred@1572161132 after org.apache.kudu.client.AsyncKuduClient$12@2f709cbd@795909309) -> (continuation of Deferred@1015643018 after org.apache.kudu.client.AsyncKuduClient$12@a1b84c8@169575624) -> (continuation of Deferred@1615216510 after org.apache.kudu.client.AsyncKuduClient$12@17378dd2@389516754), errback=(continuation of Deferred@522616378 after org.apache.kudu.client.AsyncKuduClient$2@40fb8270@1090224752) -> (continuation of Deferred@1722656002 after org.apache.kudu.client.AsyncKuduClient$12@73c83dd9@1942502873) -> (continuation of Deferred@1144250149 after org.apache.kudu.client.AsyncKuduClient$12@22ef2787@586098567) -> (continuation of Deferred@2108238572 after org.apache.kudu.client.AsyncKuduClient$12@76a7148f@1990661263) -> (continuation of Deferred@2083635399 after org.apache.kudu.client.AsyncKuduClient$12@26a1f9c1@648149441) -> (continuation of Deferred@104206923 after org.apache.kudu.client.AsyncKuduClient$12@327ca0a2@847028386) -> (continuation of Deferred@1572161132 after org.apache.kudu.client.AsyncKuduClient$12@2f709cbd@795909309) -> (continuation of Deferred@1015643018 after org.apache.kudu.client.AsyncKuduClient$12@a1b84c8@169575624) -> (continuation of Deferred@1615216510 after org.apache.kudu.client.AsyncKuduClient$12@17378dd2@389516754)), so the following Deferred is getting paused: Deferred@1615216510(state=PAUSED, result=Deferred@508501673, callback=, errback=) 03:46:42.494 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.493060 23249 raft_consensus.cc:412] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:42.494 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.493155 23249 raft_consensus.cc:2456] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Snoozing failure detection for 1.746s (starting election) 03:46:42.495 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.493281 23249 raft_consensus.cc:434] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "47e1da97776b4cd7a761f7ba221fe099" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:42.495 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.494279 23249 leader_election.cc:221] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer a8b7ee72e4d245d2a2710ab6ee79ec7d 03:46:42.495 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.494590 23249 leader_election.cc:221] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 47e1da97776b4cd7a761f7ba221fe099 03:46:42.527 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.527736 22767 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "e721bf7222df463b9b8ab9f032f01dbc" candidate_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" is_pre_election: true 03:46:42.528 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.527973 22767 raft_consensus.cc:2456] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: Snoozing failure detection for 1.543s (vote granted) 03:46:42.528 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.528029 22767 raft_consensus.cc:2010] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e820884ca0b45fbbbd865f9dafc2d04 in term 0. 03:46:42.528 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.528542 22911 leader_election.cc:353] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 pre-election: Vote granted by peer a8b7ee72e4d245d2a2710ab6ee79ec7d 03:46:42.529 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.528599 22911 leader_election.cc:248] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:42.530 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.529165 23249 raft_consensus.cc:2456] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Snoozing failure detection for 2.150s (election complete) 03:46:42.530 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.529212 23249 raft_consensus.cc:2280] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:42.530 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.529232 23249 raft_consensus.cc:412] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:42.530 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.529242 23249 raft_consensus.cc:2456] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Snoozing failure detection for 1.939s (starting election) 03:46:42.531 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.529255 23249 raft_consensus.cc:2508] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 0 FOLLOWER]: Advancing to term 1 03:46:42.531 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.530244 23249 raft_consensus.cc:434] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "47e1da97776b4cd7a761f7ba221fe099" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:42.531 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.530540 23249 leader_election.cc:221] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 election: Requesting vote from peer a8b7ee72e4d245d2a2710ab6ee79ec7d 03:46:42.531 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.530637 23249 leader_election.cc:221] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 election: Requesting vote from peer 47e1da97776b4cd7a761f7ba221fe099 03:46:42.531 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.531723 22767 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "e721bf7222df463b9b8ab9f032f01dbc" candidate_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" 03:46:42.531 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.531807 22767 raft_consensus.cc:2508] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d [term 0 FOLLOWER]: Advancing to term 1 03:46:42.531 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.531888 22767 raft_consensus.cc:2456] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d: Snoozing failure detection for 1.677s (vote granted) 03:46:42.532 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.532716 22767 raft_consensus.cc:2010] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e820884ca0b45fbbbd865f9dafc2d04 in term 1. 03:46:42.534 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.534212 22911 leader_election.cc:353] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 election: Vote granted by peer a8b7ee72e4d245d2a2710ab6ee79ec7d 03:46:42.534 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.534245 22911 leader_election.cc:248] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:42.534 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.534621 23249 raft_consensus.cc:2456] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04: Snoozing failure detection for 1.751s (election complete) 03:46:42.534 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.534658 23249 raft_consensus.cc:2280] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 1 FOLLOWER]: Leader election won for term 1 03:46:42.541 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.540055 22888 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "e721bf7222df463b9b8ab9f032f01dbc" candidate_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47e1da97776b4cd7a761f7ba221fe099" 03:46:42.541 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.540066 22889 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "e721bf7222df463b9b8ab9f032f01dbc" candidate_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47e1da97776b4cd7a761f7ba221fe099" is_pre_election: true 03:46:42.541 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.540211 22888 raft_consensus.cc:2508] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [term 0 FOLLOWER]: Advancing to term 1 03:46:42.541 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.540338 22888 raft_consensus.cc:2456] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099: Snoozing failure detection for 1.665s (vote granted) 03:46:42.541 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.541211 22888 raft_consensus.cc:2010] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e820884ca0b45fbbbd865f9dafc2d04 in term 1. 03:46:42.541 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.541299 22889 raft_consensus.cc:1985] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e820884ca0b45fbbbd865f9dafc2d04 for term 1 because replica is already servicing an update from a current leader or another vote. 03:46:42.542 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.542191 22912 leader_election.cc:353] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 election: Vote granted by peer 47e1da97776b4cd7a761f7ba221fe099 03:46:42.542 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.542568 22912 leader_election.cc:367] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 47e1da97776b4cd7a761f7ba221fe099. Message: Service unavailable: T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e820884ca0b45fbbbd865f9dafc2d04 for term 1 because replica is already servicing an update from a current leader or another vote. 03:46:42.545 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.542953 23249 raft_consensus.cc:542] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [term 1 LEADER]: Becoming Leader. State: Replica: 9e820884ca0b45fbbbd865f9dafc2d04, State: Running, Role: LEADER 03:46:42.545 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.543165 23249 consensus_queue.cc:169] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "47e1da97776b4cd7a761f7ba221fe099" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:42.557 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:42.557169 22410 catalog_manager.cc:2511] T e721bf7222df463b9b8ab9f032f01dbc reported cstate change: term changed from 0 to 1, leader changed from to 9e820884ca0b45fbbbd865f9dafc2d04 (127.70.237.1). New cstate: current_term: 1 leader_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e820884ca0b45fbbbd865f9dafc2d04" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "a8b7ee72e4d245d2a2710ab6ee79ec7d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "47e1da97776b4cd7a761f7ba221fe099" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } 03:46:42.651 [DEBUG - Time-limited test] (AsyncKuduClient.java:1727) Learned about tablet e721bf7222df463b9b8ab9f032f01dbc for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:42.652 [DEBUG - Time-limited test] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=e721bf7222df463b9b8ab9f032f01dbc, ttl=299999}] 03:46:42.652 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4191cf7d, flushNotification=Deferred@1169052567(state=PENDING, result=null, callback=, errback=)} 03:46:42.665 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@7ec344b4@2126726324 returned Deferred@828802614(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@115562854 after org.apache.kudu.client.AsyncKuduSession$1@7ec344b4@2126726324), errback=passthrough -> (continuation of Deferred@115562854 after org.apache.kudu.client.AsyncKuduSession$1@7ec344b4@2126726324)), so the following Deferred is getting paused: Deferred@115562854(state=PAUSED, result=Deferred@828802614, callback=, errback=) 03:46:42.708 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:42.707726 22889 raft_consensus.cc:964] T e721bf7222df463b9b8ab9f032f01dbc P 47e1da97776b4cd7a761f7ba221fe099 [term 1 FOLLOWER]: Refusing update from remote peer 9e820884ca0b45fbbbd865f9dafc2d04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:42.709 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.708752 23249 consensus_queue.cc:741] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [LEADER]: Connected to new peer: Peer: 47e1da97776b4cd7a761f7ba221fe099, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:42.713 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:42.713567 22767 raft_consensus.cc:964] T e721bf7222df463b9b8ab9f032f01dbc P a8b7ee72e4d245d2a2710ab6ee79ec7d [term 1 FOLLOWER]: Refusing update from remote peer 9e820884ca0b45fbbbd865f9dafc2d04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:42.714 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:42.714473 23262 consensus_queue.cc:741] T e721bf7222df463b9b8ab9f032f01dbc P 9e820884ca0b45fbbbd865f9dafc2d04 [LEADER]: Connected to new peer: Peer: a8b7ee72e4d245d2a2710ab6ee79ec7d, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:42.770 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 1 rows, more=false) 03:46:42.849 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:42.852 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:42.854 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:42.855 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:42.856 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=null, flushNotification=Deferred@1619212809(state=PENDING, result=null, callback=, errback=)} 03:46:42.858 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@4013449@67187785 returned Deferred@22238665(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1169052567 after org.apache.kudu.client.AsyncKuduSession$1@4013449@67187785), errback=passthrough -> (continuation of Deferred@1169052567 after org.apache.kudu.client.AsyncKuduSession$1@4013449@67187785)), so the following Deferred is getting paused: Deferred@1169052567(state=PAUSED, result=Deferred@22238665, callback=, errback=) 03:46:42.869 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:42.924 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:42.925 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1de714ec, flushNotification=Deferred@1691166251(state=PENDING, result=null, callback=, errback=)} 03:46:42.938 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:43.933 [DEBUG - Hashed wheel timer #4] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@63407dec, flushNotification=Deferred@1837600756(state=PENDING, result=null, callback=, errback=)} 03:46:44.013 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 11 rows, more=false) 03:46:44.031 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 31 rows, more=false) 03:46:44.053 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 03:46:44.064 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 03:46:44.064 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@1768154503(state=PENDING, result=null, callback=, errback=)} 03:46:44.066 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@7205187f@1912936575 returned Deferred@1474306727(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1837600756 after org.apache.kudu.client.AsyncKuduSession$1@7205187f@1912936575), errback=passthrough -> (continuation of Deferred@1837600756 after org.apache.kudu.client.AsyncKuduSession$1@7205187f@1912936575)), so the following Deferred is getting paused: Deferred@1837600756(state=PAUSED, result=Deferred@1474306727, callback=, errback=) 03:46:44.092 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:44.096 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:44.108 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@1519499790(state=PENDING, result=null, callback=, errback=)} 03:46:44.110 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@2c282306@740827910 returned Deferred@1991512092(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1768154503 after org.apache.kudu.client.AsyncKuduSession$1@2c282306@740827910), errback=passthrough -> (continuation of Deferred@1768154503 after org.apache.kudu.client.AsyncKuduSession$1@2c282306@740827910)), so the following Deferred is getting paused: Deferred@1768154503(state=PAUSED, result=Deferred@1991512092, callback=, errback=) 03:46:44.145 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:44.291 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:44.292 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2097e177, flushNotification=Deferred@1996582561(state=PENDING, result=null, callback=, errback=)} 03:46:44.294 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1adc5354, flushNotification=Deferred@1287558371(state=PENDING, result=null, callback=, errback=)} 03:46:44.327 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@53bd585a, flushNotification=Deferred@792023274(state=PENDING, result=null, callback=, errback=)} 03:46:44.340 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@578be0ab@1468784811 returned Deferred@1865051957(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1287558371 after org.apache.kudu.client.AsyncKuduSession$1@578be0ab@1468784811), errback=passthrough -> (continuation of Deferred@1287558371 after org.apache.kudu.client.AsyncKuduSession$1@578be0ab@1468784811)), so the following Deferred is getting paused: Deferred@1287558371(state=PAUSED, result=Deferred@1865051957, callback=, errback=) 03:46:44.357 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 21 rows, more=false) 03:46:44.360 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@566c9502, flushNotification=Deferred@1398484261(state=PENDING, result=null, callback=, errback=)} 03:46:44.391 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=32), No traces, null) with no deferred attached! 03:46:44.401 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5b5d015d, flushNotification=Deferred@1731370692(state=PENDING, result=null, callback=, errback=)} 03:46:44.402 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@55c4d3a5@1438962597 returned Deferred@1610411581(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1398484261 after org.apache.kudu.client.AsyncKuduSession$1@55c4d3a5@1438962597), errback=passthrough -> (continuation of Deferred@1398484261 after org.apache.kudu.client.AsyncKuduSession$1@55c4d3a5@1438962597)), so the following Deferred is getting paused: Deferred@1398484261(state=PAUSED, result=Deferred@1610411581, callback=, errback=) 03:46:44.415 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:46:44.420 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:46:44.433 [DEBUG - New I/O worker #199] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:46:44.434 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1813535606(state=PENDING, result=null, callback=, errback=)} 03:46:44.435 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1f2f3c8f, flushNotification=Deferred@1812307252(state=PENDING, result=null, callback=, errback=)} 03:46:44.461 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@54301b8f, flushNotification=Deferred@2061314452(state=PENDING, result=null, callback=, errback=)} 03:46:44.463 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1c70b904, flushNotification=Deferred@1557953411(state=PENDING, result=null, callback=, errback=)} 03:46:44.475 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@864eff4, flushNotification=Deferred@468117221(state=PENDING, result=null, callback=, errback=)} 03:46:44.499 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@247d404, flushNotification=Deferred@1031317420(state=PENDING, result=null, callback=, errback=)} 03:46:44.515 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@12cce4b8, flushNotification=Deferred@1051851210(state=PENDING, result=null, callback=, errback=)} 03:46:44.530 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2eafdec, flushNotification=Deferred@2060943322(state=PENDING, result=null, callback=, errback=)} 03:46:44.543 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@f4bbd1c, flushNotification=Deferred@1040542358(state=PENDING, result=null, callback=, errback=)} 03:46:44.560 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6b55f527, flushNotification=Deferred@717061688(state=PENDING, result=null, callback=, errback=)} 03:46:44.590 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:44.597 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1829241195(state=PENDING, result=null, callback=, errback=)} 03:46:44.604 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@29302d20, flushNotification=Deferred@1748884096(state=PENDING, result=null, callback=, errback=)} 03:46:44.638 [DEBUG - New I/O worker #201] (AsyncKuduClient.java:1727) Learned about tablet e721bf7222df463b9b8ab9f032f01dbc for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:44.639 [DEBUG - New I/O worker #201] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=e721bf7222df463b9b8ab9f032f01dbc, ttl=299999}] 03:46:44.643 [DEBUG - New I/O worker #201] (AsyncKuduClient.java:1727) Learned about tablet e721bf7222df463b9b8ab9f032f01dbc for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:44.643 [DEBUG - New I/O worker #201] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=e721bf7222df463b9b8ab9f032f01dbc, ttl=299999}] 03:46:44.644 [DEBUG - New I/O worker #201] (AsyncKuduClient.java:1727) Learned about tablet e721bf7222df463b9b8ab9f032f01dbc for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:44.644 [DEBUG - New I/O worker #201] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=e721bf7222df463b9b8ab9f032f01dbc, ttl=299999}] 03:46:44.647 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7444d74c, flushNotification=Deferred@1508545526(state=PENDING, result=null, callback=, errback=)} 03:46:44.663 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@711becc6, flushNotification=Deferred@2004140479(state=PENDING, result=null, callback=, errback=)} 03:46:44.713 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:44.713685 22912 outbound_call.cc:286] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.70.237.1:64038, user_credentials={real_user=jenkins-slave}} blocked reactor thread for 50373.2us 03:46:44.716 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@255886aa, flushNotification=Deferred@673236180(state=PENDING, result=null, callback=, errback=)} 03:46:44.749 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@67370ca, flushNotification=Deferred@1473978498(state=PENDING, result=null, callback=, errback=)} 03:46:44.762 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@36d79105, flushNotification=Deferred@411039087(state=PENDING, result=null, callback=, errback=)} 03:46:44.774 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@597338a, flushNotification=Deferred@197577866(state=PENDING, result=null, callback=, errback=)} 03:46:44.781 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1132b4e, flushNotification=Deferred@1721787022(state=PENDING, result=null, callback=, errback=)} 03:46:44.785 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5a9716b3, flushNotification=Deferred@1728590839(state=PENDING, result=null, callback=, errback=)} 03:46:44.791 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7f593d03, flushNotification=Deferred@436765812(state=PENDING, result=null, callback=, errback=)} 03:46:44.799 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2017995528(state=PENDING, result=null, callback=, errback=)} 03:46:44.804 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5e79387d, flushNotification=Deferred@1761523604(state=PENDING, result=null, callback=, errback=)} 03:46:44.805 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@368ba5db, flushNotification=Deferred@262326377(state=PENDING, result=null, callback=, errback=)} 03:46:44.817 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@403682096(state=PENDING, result=null, callback=, errback=)} 03:46:44.823 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=17), No traces, null) with no deferred attached! 03:46:44.827 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@89191858(state=PENDING, result=null, callback=, errback=)} 03:46:44.834 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=7), No traces, null) with no deferred attached! 03:46:44.838 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1847475646(state=PENDING, result=null, callback=, errback=)} 03:46:44.844 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=6), No traces, null) with no deferred attached! 03:46:44.848 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2003194260(state=PENDING, result=null, callback=, errback=)} 03:46:44.855 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=7), No traces, null) with no deferred attached! 03:46:44.859 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@303426171(state=PENDING, result=null, callback=, errback=)} 03:46:44.866 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=7), No traces, null) with no deferred attached! 03:46:44.870 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@283799790(state=PENDING, result=null, callback=, errback=)} 03:46:44.877 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=6), No traces, null) with no deferred attached! 03:46:44.883 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@260459648(state=PENDING, result=null, callback=, errback=)} 03:46:44.890 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:44.892 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1252607509(state=PENDING, result=null, callback=, errback=)} 03:46:44.898 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=6), No traces, null) with no deferred attached! 03:46:44.902 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2001877769(state=PENDING, result=null, callback=, errback=)} 03:46:44.913 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@347c480d, flushNotification=Deferred@153350222(state=PENDING, result=null, callback=, errback=)} 03:46:44.920 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@9ba8691, flushNotification=Deferred@1867939548(state=PENDING, result=null, callback=, errback=)} 03:46:44.933 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@960261915(state=PENDING, result=null, callback=, errback=)} 03:46:44.934 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2f8b49f2, flushNotification=Deferred@1926810780(state=PENDING, result=null, callback=, errback=)} 03:46:44.956 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@782560389(state=PENDING, result=null, callback=, errback=)} 03:46:44.965 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=30), No traces, null) with no deferred attached! 03:46:44.966 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1949965053(state=PENDING, result=null, callback=, errback=)} 03:46:44.969 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@18b1951, flushNotification=Deferred@889428432(state=PENDING, result=null, callback=, errback=)} 03:46:44.979 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1019906865(state=PENDING, result=null, callback=, errback=)} 03:46:44.985 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=16), No traces, null) with no deferred attached! 03:46:44.986 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@402883495(state=PENDING, result=null, callback=, errback=)} 03:46:44.987 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@419b4067, flushNotification=Deferred@1761582237(state=PENDING, result=null, callback=, errback=)} 03:46:45.000 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@8411b0, flushNotification=Deferred@69121212(state=PENDING, result=null, callback=, errback=)} 03:46:45.008 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@522011680(state=PENDING, result=null, callback=, errback=)} 03:46:45.015 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=15), No traces, null) with no deferred attached! 03:46:45.019 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@185739306(state=PENDING, result=null, callback=, errback=)} 03:46:45.027 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:46:45.046 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@725332329(state=PENDING, result=null, callback=, errback=)} 03:46:45.056 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:46:45.060 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1525767142(state=PENDING, result=null, callback=, errback=)} 03:46:45.068 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:45.073 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@792209628(state=PENDING, result=null, callback=, errback=)} 03:46:45.076 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@35f11669, flushNotification=Deferred@1136089415(state=PENDING, result=null, callback=, errback=)} 03:46:45.085 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@323552444(state=PENDING, result=null, callback=, errback=)} 03:46:45.092 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=15), No traces, null) with no deferred attached! 03:46:45.093 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2103029953(state=PENDING, result=null, callback=, errback=)} 03:46:45.099 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=6), No traces, null) with no deferred attached! 03:46:45.100 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1084662621(state=PENDING, result=null, callback=, errback=)} 03:46:45.107 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=6), No traces, null) with no deferred attached! 03:46:45.108 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@966961007(state=PENDING, result=null, callback=, errback=)} 03:46:45.115 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=6), No traces, null) with no deferred attached! 03:46:45.115 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1653946371(state=PENDING, result=null, callback=, errback=)} 03:46:45.121 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=5), No traces, null) with no deferred attached! 03:46:45.125 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1392132904(state=PENDING, result=null, callback=, errback=)} 03:46:45.132 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=6), No traces, null) with no deferred attached! 03:46:45.133 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@666091105(state=PENDING, result=null, callback=, errback=)} 03:46:45.141 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:45.142 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@193391655(state=PENDING, result=null, callback=, errback=)} 03:46:45.145 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@40989874, flushNotification=Deferred@1090220108(state=PENDING, result=null, callback=, errback=)} 03:46:45.153 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2055315076(state=PENDING, result=null, callback=, errback=)} 03:46:45.159 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=14), No traces, null) with no deferred attached! 03:46:45.163 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 50 rows, more=false) 03:46:45.165 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@465ab227, flushNotification=Deferred@1116064160(state=PENDING, result=null, callback=, errback=)} 03:46:45.177 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=12), No traces, null) with no deferred attached! 03:46:45.178 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@59e7a8ac, flushNotification=Deferred@795109546(state=PENDING, result=null, callback=, errback=)} 03:46:45.188 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=9), No traces, null) with no deferred attached! 03:46:45.188 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$2@3cbc3ceb@1018969323 returned Deferred@795109546(state=PENDING, result=null, callback=(continuation of Deferred@1116064160 after org.apache.kudu.client.AsyncKuduSession$2@3cbc3ceb@1018969323), errback=(continuation of Deferred@1116064160 after org.apache.kudu.client.AsyncKuduSession$2@3cbc3ceb@1018969323)), so the following Deferred is getting paused: Deferred@1116064160(state=PAUSED, result=Deferred@795109546, callback=, errback=) 03:46:45.199 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:46:45.209 [DEBUG - New I/O worker #201] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:46:45.210 [DEBUG - New I/O worker #200] (Connection.java:666) [peer 9e820884ca0b45fbbbd865f9dafc2d04] cleaning up while in state READY due to: connection disconnected 03:46:45.213 [DEBUG - New I/O worker #196] (Connection.java:666) [peer master-127.70.237.1:64030] cleaning up while in state READY due to: connection disconnected 03:46:45.217 [DEBUG - New I/O worker #197] (Connection.java:666) [peer master-127.70.237.1:64032] cleaning up while in state READY due to: connection disconnected 03:46:45.222 [DEBUG - main] (Deferred.java:1330) callback=disconnect callback@990355670 returned Deferred@296347592(state=PENDING, result=null, callback=release resources callback -> (continuation of Deferred@956420404 after disconnect callback@990355670), errback=passthrough -> (continuation of Deferred@956420404 after disconnect callback@990355670)), so the following Deferred is getting paused: Deferred@956420404(state=PAUSED, result=Deferred@296347592, callback=, errback=) 03:46:45.224 [DEBUG - New I/O worker #198] (AsyncKuduClient.java:1872) Releasing all remaining resources 03:46:45.233 [DEBUG - New I/O worker #198] (Connection.java:666) [peer master-127.70.237.1:64034] cleaning up while in state READY due to: connection disconnected 03:46:45.257 [DEBUG - New I/O worker #134] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:46:45.258 [DEBUG - New I/O worker #132] (Connection.java:666) [peer master-127.70.237.1:64032] cleaning up while in state READY due to: connection disconnected 03:46:45.275 [DEBUG - New I/O worker #133] (Connection.java:666) [peer master-127.70.237.1:64034] cleaning up while in state READY due to: connection disconnected 03:46:45.287 [DEBUG - New I/O worker #131] (Connection.java:666) [peer master-127.70.237.1:64030] cleaning up while in state READY due to: connection disconnected 03:46:45.636 [INFO - main] (BaseKuduTest.java:75) Setting up before class... 03:46:45.645 [INFO - main] (MiniKuduCluster.java:152) Starting 3 masters... 03:46:45.780 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:45.780 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:45.779973 23941 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:45.782 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:45.782079 23941 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:45.782 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:45.782366 23941 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:45.782 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:45.782563 23941 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:45.782 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:45.782783 23941 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:45.785123 23941 master_main.cc:66] Master server non-default flags: 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706405646/data 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706405646/data 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64030 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_port=64031 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --never_fsync=true 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.23941 03:46:45.785 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706405646/logs 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --logtostderr=true 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Master server version: 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build type DEBUG 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:45.786 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build id 9998 03:46:45.870 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:45.869942 23941 minidump.cc:237] Setting minidump size limit to 20M 03:46:45.901 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:45.900671 23941 master_main.cc:73] Initializing master server... 03:46:45.901 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:45.901435 23941 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 446829 03:46:45.948 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:45.948158 23941 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706405646/data/instance: No such file or directory (error 2) 03:46:45.948 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:45.948204 23941 server_base.cc:229] Creating new FS layout 03:46:45.955 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:45.955236 23941 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706405646/data/instance: 03:46:45.955 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "6ab65063aff344aa882efaffd4270f9e" 03:46:45.955 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:45 on jenkins-slave-c3oe" 03:46:46.005 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.005802 23941 fs_manager.cc:431] Time spent creating directory manager: real 0.050s user 0.004s sys 0.000s 03:46:46.006 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.006418 23941 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:46.006 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.006623 23941 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:46.021 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.021747 23941 fs_manager.cc:335] Time spent opening block manager: real 0.013s user 0.004s sys 0.000s 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.022284 23941 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706405646/data 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "6ab65063aff344aa882efaffd4270f9e" 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:45 on jenkins-slave-c3oe" 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.022617 23941 fs_report.cc:347] Block manager report 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) -------------------- 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706405646/data/data 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:46.022 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:46.023 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:46.023 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:46.023 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:46.023 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:46.023 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:46.023 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:46.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:46.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:46.105504 23971 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:46.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:46.106405 23971 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:46.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:46.106421 23971 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:46.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:46.106426 23971 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:46.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:46.106444 23971 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:46.107 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.107631 23971 master_main.cc:66] Master server non-default flags: 03:46:46.107 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:46.107 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:46.107 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706405646/data 03:46:46.107 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706405646/data 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64032 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_port=64033 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --never_fsync=true 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.23971 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706405646/logs 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --logtostderr=true 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Master server version: 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build type DEBUG 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:46.108 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build id 9998 03:46:46.145 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.145656 23971 minidump.cc:237] Setting minidump size limit to 20M 03:46:46.173 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.173820 23971 master_main.cc:73] Initializing master server... 03:46:46.174 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.174899 23971 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 447329 03:46:46.181 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.181447 23941 master_main.cc:76] Starting Master server... 03:46:46.197 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.197263 24003 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:46.197 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.197669 24003 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:46.197 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.197865 24003 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:46.205 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.201529 23971 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706405646/data/instance: No such file or directory (error 2) 03:46:46.205 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.201571 23971 server_base.cc:229] Creating new FS layout 03:46:46.212 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.212064 23971 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706405646/data/instance: 03:46:46.212 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "1a5324bcd02b469f981db8c278cb16d5" 03:46:46.212 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:46 on jenkins-slave-c3oe" 03:46:46.280 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.276733 23971 fs_manager.cc:431] Time spent creating directory manager: real 0.064s user 0.008s sys 0.000s 03:46:46.280 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.277447 23971 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:46.280 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.277637 23971 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.301813 23971 fs_manager.cc:335] Time spent opening block manager: real 0.022s user 0.004s sys 0.000s 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.301980 23971 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706405646/data 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "1a5324bcd02b469f981db8c278cb16d5" 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:46 on jenkins-slave-c3oe" 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.302064 23971 fs_report.cc:347] Block manager report 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) -------------------- 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706405646/data/data 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:46.307 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:46.308 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:46.308 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:46.308 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:46.308 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:46.308 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:46.308 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:46.601 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:46.601 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.600675 23941 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64030 03:46:46.602 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.601084 23941 webserver.cc:149] Starting webserver on 127.70.237.1:64031 03:46:46.602 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.601099 23941 webserver.cc:160] Document root disabled 03:46:46.602 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.601616 23941 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64031/ 03:46:46.605 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:46.601124 24026 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:46.607 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:46.607453 24026 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:46.607 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:46.607801 24026 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:46.608 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:46.608005 24026 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:46.608 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:46.608218 24026 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:46.610 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.610543 24026 master_main.cc:66] Master server non-default flags: 03:46:46.610 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:46.610 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:46.610 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706405646/data 03:46:46.610 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706405646/data 03:46:46.610 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:46.610 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64034 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_port=64035 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --never_fsync=true 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.24026 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706405646/logs 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --logtostderr=true 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Master server version: 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build type DEBUG 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:46.611 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build id 9998 03:46:46.632 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.632182 24089 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:46.673 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.673919 24089 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:46.674 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:46.674820 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:46.701 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.701294 23971 master_main.cc:76] Starting Master server... 03:46:46.705 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.705037 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 1 03:46:46.706 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:46.706326 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:46.720 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.720669 24104 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:46.720 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.720710 24104 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:46.720 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:46.720715 24104 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:46.721 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.721040 24026 minidump.cc:237] Setting minidump size limit to 20M 03:46:46.745 [INFO - main] (MiniKuduCluster.java:155) Starting 3 tablet servers... 03:46:46.756 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.756507 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 2 03:46:46.757 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:46.757930 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:46.817 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.816687 24026 master_main.cc:73] Initializing master server... 03:46:46.817 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.817493 24026 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 447329 03:46:46.834 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:46.834105 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 3 03:46:46.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:46.835256 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:46.848 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.843866 24026 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706405646/data/instance: No such file or directory (error 2) 03:46:46.848 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.843911 24026 server_base.cc:229] Creating new FS layout 03:46:46.853 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.853889 24026 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706405646/data/instance: 03:46:46.854 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" 03:46:46.854 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:46 on jenkins-slave-c3oe" 03:46:46.894 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:46.894 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:46.894495 24113 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:46.894 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.894924 24026 fs_manager.cc:431] Time spent creating directory manager: real 0.040s user 0.004s sys 0.000s 03:46:46.896 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:46.896513 24113 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:46.896 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:46.896778 24113 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:46.896 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:46.896970 24113 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:46.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:46.898774 24113 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:46.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:46.898 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706406745/data 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706406745/data 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64036 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.24113 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706406745/logs 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type DEBUG 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:46.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 9998 03:46:46.904 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.904055 24026 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:46.904 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.904320 24026 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:46.954 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:46.953972 24113 minidump.cc:237] Setting minidump size limit to 20M 03:46:46.976 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.976850 24026 fs_manager.cc:335] Time spent opening block manager: real 0.070s user 0.004s sys 0.000s 03:46:46.979 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.979176 24026 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706405646/data 03:46:46.979 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" 03:46:46.979 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:46 on jenkins-slave-c3oe" 03:46:46.979 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:46.979720 24026 fs_report.cc:347] Block manager report 03:46:46.979 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) -------------------- 03:46:46.979 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706405646/data/data 03:46:46.979 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:46.979 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:46.980 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:46.980 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:46.980 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:46.980 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:46.980 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:46.980 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:46.980 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:46.980 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:47.006 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.006574 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 4 03:46:47.008 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:47.008056 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:47.068 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.068678 24113 tablet_server_main.cc:79] Initializing tablet server... 03:46:47.069 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.069937 24113 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 447829 03:46:47.120 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.114363 24113 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706406745/data/instance: No such file or directory (error 2) 03:46:47.120 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.114406 24113 server_base.cc:229] Creating new FS layout 03:46:47.120 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.118965 24113 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706406745/data/instance: 03:46:47.120 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "265b79d01c454f83bf2fb4781b33418b" 03:46:47.120 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:47 on jenkins-slave-c3oe" 03:46:47.131 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.131639 23971 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64032 03:46:47.132 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.132367 23971 webserver.cc:149] Starting webserver on 127.70.237.1:64033 03:46:47.132 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.132617 23971 webserver.cc:160] Document root disabled 03:46:47.133 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.133218 23971 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64033/ 03:46:47.140 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.140646 24219 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:47.144 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.141500 24113 fs_manager.cc:431] Time spent creating directory manager: real 0.022s user 0.008s sys 0.000s 03:46:47.144 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.142031 24113 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:47.145 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.142212 24113 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:47.157 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.157933 24219 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:47.161 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.161438 24026 master_main.cc:76] Starting Master server... 03:46:47.163 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.163543 24113 fs_manager.cc:335] Time spent opening block manager: real 0.019s user 0.004s sys 0.000s 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.164007 24113 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706406745/data 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "265b79d01c454f83bf2fb4781b33418b" 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:47 on jenkins-slave-c3oe" 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.164458 24113 fs_report.cc:347] Block manager report 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706406745/data/data 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:47.164 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:47.165 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:47.165 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:47.168 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:47.168 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.168594 24219 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:47.168 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:47.168370 24178 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:47.169 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:47.169776 24178 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:47.170 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:47.169967 24219 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.170 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:47.170001 24178 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:47.170 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:47.170080 24178 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:47.171 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.171654 24178 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:47.171 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:47.171 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706406745/data 03:46:47.171 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706406745/data 03:46:47.171 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64038 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.24178 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706406745/logs 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type DEBUG 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:47.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 9998 03:46:47.176 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.176640 24230 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:47.176 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.176892 24230 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:47.177 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.177027 24230 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:47.197 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.196954 24178 minidump.cc:237] Setting minidump size limit to 20M 03:46:47.210 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.210604 24219 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 1 03:46:47.212 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:47.212249 24219 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.248 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.248831 24219 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 2 03:46:47.250 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:47.250160 24219 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.256 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.256669 24178 tablet_server_main.cc:79] Initializing tablet server... 03:46:47.257 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.257506 24178 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 447829 03:46:47.268 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.268247 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 5 03:46:47.272 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.272832 24113 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:47.275 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.274806 24089 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:47.275 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:47.275746 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.276 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.271162 24178 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706406745/data/instance: No such file or directory (error 2) 03:46:47.276 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.271199 24178 server_base.cc:229] Creating new FS layout 03:46:47.276 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.275648 24178 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706406745/data/instance: 03:46:47.276 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "c60b08ee97c3491bb898ef6298493658" 03:46:47.276 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:47 on jenkins-slave-c3oe" 03:46:47.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.308547 24113 tablet_server_main.cc:84] Starting tablet server... 03:46:47.317 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.316952 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 1 03:46:47.318 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:47.318351 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.338 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.338649 24219 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 3 03:46:47.340 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:47.339962 24219 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.354 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.353557 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 2 03:46:47.355 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:47.355085 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.369 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.369477 24178 fs_manager.cc:431] Time spent creating directory manager: real 0.094s user 0.008s sys 0.004s 03:46:47.370 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.370026 24178 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:47.370 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.370213 24178 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:47.377 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.377640 24178 fs_manager.cc:335] Time spent opening block manager: real 0.005s user 0.000s sys 0.000s 03:46:47.377 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.377805 24178 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706406745/data 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "c60b08ee97c3491bb898ef6298493658" 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:47 on jenkins-slave-c3oe" 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.377882 24178 fs_report.cc:347] Block manager report 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706406745/data/data 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:47.378 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:47.462 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.461313 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 3 03:46:47.462 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:47.462690 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.471 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.471177 24219 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 4 03:46:47.472 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:47.472564 24219 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.598 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.597898 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 4 03:46:47.599 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:47.599267 24089 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64034: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:47.606 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.604995 24026 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64034 03:46:47.606 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.605433 24026 webserver.cc:149] Starting webserver on 127.70.237.1:64035 03:46:47.606 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.605449 24026 webserver.cc:160] Document root disabled 03:46:47.606 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.605967 24026 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64035/ 03:46:47.636 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.636476 24338 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:47.644 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:47.644 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:47.644224 24296 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:47.646 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:47.646004 24296 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:47.649 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:47.648995 24296 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:47.649 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:47.649358 24296 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:47.649 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.649557 24178 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:47.652 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.652724 24296 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:47.652 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706406745/data 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706406745/data 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64040 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.24296 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706406745/logs 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:47.653 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:47.654 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type DEBUG 03:46:47.654 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:47.654 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 9998 03:46:47.665 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:47.664526 24178 tablet_server_main.cc:84] Starting tablet server... 03:46:47.668 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.668135 24296 minidump.cc:237] Setting minidump size limit to 20M 03:46:47.673 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.673569 24338 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:47.680 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.680402 24338 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:47.702 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.698941 24338 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: Bootstrap starting. 03:46:47.702 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.701076 24338 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: No blocks or log segments found. Creating new log. 03:46:47.702 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.701933 24338 log.cc:518] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: Log is configured to *not* fsync() on all Append() calls 03:46:47.710 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.710407 24338 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: No bootstrap required, opened a new log 03:46:47.712 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.712756 24338 raft_consensus.cc:287] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:47.713 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.713196 24338 raft_consensus.cc:313] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:47.713 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.713733 24338 raft_consensus.cc:576] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bf1c2c782eb45ecabaf02b6d6d71c83, State: Initialized, Role: FOLLOWER 03:46:47.714 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.714030 24338 consensus_queue.cc:190] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:47.720 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.720847 24338 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:47.721 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.721297 24338 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [sys.catalog]: This master's current role is: FOLLOWER 03:46:47.722 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.722606 24338 sys_catalog.cc:408] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [sys.catalog]: configured and running, proceeding with master startup. 03:46:47.723 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.723150 24375 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:47.723 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.723407 24375 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [sys.catalog]: This master's current role is: FOLLOWER 03:46:47.730 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 03:46:47.730 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.730684 24219 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 5 03:46:47.732 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.732697 24377 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 03:46:47.733 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.733781 24026 master_main.cc:79] Master server successfully started. 03:46:47.737 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.736666 24296 tablet_server_main.cc:79] Initializing tablet server... 03:46:47.737 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.737431 24296 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 447829 03:46:47.743 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.740371 24219 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5: Bootstrap starting. 03:46:47.743 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.742620 24219 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5: No blocks or log segments found. Creating new log. 03:46:47.743 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.743482 24219 log.cc:518] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5: Log is configured to *not* fsync() on all Append() calls 03:46:47.749 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.749653 24219 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5: No bootstrap required, opened a new log 03:46:47.751 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.751621 24219 raft_consensus.cc:287] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:47.751 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.751966 24219 raft_consensus.cc:313] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:47.752 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.752496 24219 raft_consensus.cc:576] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5324bcd02b469f981db8c278cb16d5, State: Initialized, Role: FOLLOWER 03:46:47.752 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.752797 24219 consensus_queue.cc:190] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:47.764 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.764842 24219 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:47.765 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.765288 24219 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: This master's current role is: FOLLOWER 03:46:47.766 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.766408 24219 sys_catalog.cc:408] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: configured and running, proceeding with master startup. 03:46:47.766 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.766902 24390 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:47.767 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.767127 24390 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: This master's current role is: FOLLOWER 03:46:47.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.763249 24296 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706406745/data/instance: No such file or directory (error 2) 03:46:47.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.763286 24296 server_base.cc:229] Creating new FS layout 03:46:47.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.767521 24296 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706406745/data/instance: 03:46:47.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "8131cd1a1d2c49e69f750b365d0687e0" 03:46:47.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:47 on jenkins-slave-c3oe" 03:46:47.780 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.780843 23971 master_main.cc:79] Master server successfully started. 03:46:47.815 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.814972 24375 raft_consensus.cc:412] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:47.815 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.815490 24375 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: Snoozing failure detection for 0.654s (starting election) 03:46:47.815 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.815857 24375 raft_consensus.cc:434] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:47.816 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.816934 24375 leader_election.cc:221] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 6ab65063aff344aa882efaffd4270f9e 03:46:47.818 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.818142 24375 leader_election.cc:221] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 1a5324bcd02b469f981db8c278cb16d5 03:46:47.820 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.819912 24182 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5324bcd02b469f981db8c278cb16d5" is_pre_election: true 03:46:47.820 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.820119 24182 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5: Snoozing failure detection for 0.745s (vote granted) 03:46:47.820 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.820170 24182 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bf1c2c782eb45ecabaf02b6d6d71c83 in term 0. 03:46:47.821 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.821235 24296 fs_manager.cc:431] Time spent creating directory manager: real 0.053s user 0.004s sys 0.004s 03:46:47.821 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.821058 24162 leader_election.cc:353] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 1a5324bcd02b469f981db8c278cb16d5 03:46:47.821 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.821099 24162 leader_election.cc:248] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:47.822 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.821972 24296 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:47.822 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.822347 24296 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:47.823 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.823889 24182 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5324bcd02b469f981db8c278cb16d5" 03:46:47.823 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.821815 24484 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: Snoozing failure detection for 0.814s (election complete) 03:46:47.824 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.821863 24484 raft_consensus.cc:2280] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:47.824 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.821889 24484 raft_consensus.cc:412] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:47.824 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.821904 24484 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: Snoozing failure detection for 0.762s (starting election) 03:46:47.824 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.821916 24484 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 0 FOLLOWER]: Advancing to term 1 03:46:47.824 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.822906 24484 raft_consensus.cc:434] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:47.824 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.823210 24484 leader_election.cc:221] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 election: Requesting vote from peer 6ab65063aff344aa882efaffd4270f9e 03:46:47.824 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.823323 24484 leader_election.cc:221] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 election: Requesting vote from peer 1a5324bcd02b469f981db8c278cb16d5 03:46:47.824 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.823964 24182 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [term 0 FOLLOWER]: Advancing to term 1 03:46:47.824 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.824045 24182 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5: Snoozing failure detection for 0.638s (vote granted) 03:46:47.824 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.824867 24182 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bf1c2c782eb45ecabaf02b6d6d71c83 in term 1. 03:46:47.825 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.825134 24162 leader_election.cc:353] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 election: Vote granted by peer 1a5324bcd02b469f981db8c278cb16d5 03:46:47.825 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.825165 24162 leader_election.cc:248] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:47.825 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.825331 24484 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: Snoozing failure detection for 0.848s (election complete) 03:46:47.825 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.825373 24484 raft_consensus.cc:2280] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 1 FOLLOWER]: Leader election won for term 1 03:46:47.828 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.825450 24484 raft_consensus.cc:542] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [term 1 LEADER]: Becoming Leader. State: Replica: 1bf1c2c782eb45ecabaf02b6d6d71c83, State: Running, Role: LEADER 03:46:47.828 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.825635 24484 consensus_queue.cc:169] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:47.835 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.835191 24113 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64036 03:46:47.835 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.835901 24113 webserver.cc:149] Starting webserver on 127.70.237.1:64037 03:46:47.836 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.836107 24113 webserver.cc:160] Document root disabled 03:46:47.836 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.836812 24113 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64037/ 03:46:47.837 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.837126 24375 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bf1c2c782eb45ecabaf02b6d6d71c83. Latest consensus state: current_term: 1 leader_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:47.837 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.837374 24375 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [sys.catalog]: This master's current role is: LEADER 03:46:47.844 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.844518 24519 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:47.845 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.844986 24519 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:47.845 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.844604 24113 tablet_server_main.cc:87] Tablet server successfully started. 03:46:47.845 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.845223 24519 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:47.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.851184 24296 fs_manager.cc:335] Time spent opening block manager: real 0.026s user 0.000s sys 0.000s 03:46:47.852 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.852658 24296 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706406745/data 03:46:47.852 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "8131cd1a1d2c49e69f750b365d0687e0" 03:46:47.852 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:47 on jenkins-slave-c3oe" 03:46:47.852 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.852917 24516 catalog_manager.cc:948] Loading table and tablet metadata into memory... 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:47.853166 24296 fs_report.cc:347] Block manager report 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706406745/data/data 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:47.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:47.882 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.882472 24089 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } attempt: 5 03:46:47.884 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.884248 24516 catalog_manager.cc:959] Initializing Kudu internal certificate authority... 03:46:47.917 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.915143 24089 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e: Bootstrap starting. 03:46:47.917 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.917379 24089 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e: No blocks or log segments found. Creating new log. 03:46:47.926 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.925999 24182 raft_consensus.cc:964] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [term 1 FOLLOWER]: Refusing update from remote peer 1bf1c2c782eb45ecabaf02b6d6d71c83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:47.927 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.927355 24484 consensus_queue.cc:741] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [LEADER]: Connected to new peer: Peer: 1a5324bcd02b469f981db8c278cb16d5, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:47.949 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.949004 24390 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bf1c2c782eb45ecabaf02b6d6d71c83. Latest consensus state: current_term: 1 leader_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:47.949 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.949043 24390 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: This master's current role is: FOLLOWER 03:46:47.950 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.949759 24514 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:47.950 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.949930 24514 heartbeater.cc:387] Registering TS with master... 03:46:47.950 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.950345 24514 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:47.952 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.951987 24141 ts_manager.cc:81] Registered new tserver with Master: 265b79d01c454f83bf2fb4781b33418b (127.70.237.1:64036) 03:46:47.954 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.953761 24513 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:47.954 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.953807 24513 heartbeater.cc:387] Registering TS with master... 03:46:47.954 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.953987 24513 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:47.955 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:47.955530 24513 heartbeater.cc:524] Failed to heartbeat to 127.70.237.1:64030: Service unavailable: Catalog manager is not initialized. State: 1 03:46:47.956 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.955561 24513 heartbeater.cc:387] Registering TS with master... 03:46:47.956 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.955674 24513 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:47.957 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:47.956714 24513 heartbeater.cc:524] Failed to heartbeat to 127.70.237.1:64030: Service unavailable: Catalog manager is not initialized. State: 1 03:46:47.957 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.956743 24513 heartbeater.cc:387] Registering TS with master... 03:46:47.957 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.956845 24513 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:47.957 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.957190 24390 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:47.957 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:47.957231 24390 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1a5324bcd02b469f981db8c278cb16d5 [sys.catalog]: This master's current role is: FOLLOWER 03:46:47.957 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:47.957773 24513 heartbeater.cc:524] Failed to heartbeat to 127.70.237.1:64030: Service unavailable: Catalog manager is not initialized. State: 1 03:46:47.957 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:47.957803 24513 heartbeater.cc:351] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. 03:46:47.960 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.959595 24518 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:47.960 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.959635 24518 heartbeater.cc:387] Registering TS with master... 03:46:47.960 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:47.959763 24518 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:47.961 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:47.961130 24089 log.cc:518] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e: Log is configured to *not* fsync() on all Append() calls 03:46:47.968 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.964659 24516 catalog_manager.cc:846] Generated new certificate authority record 03:46:47.968 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.965946 24516 catalog_manager.cc:968] Loading token signing keys... 03:46:47.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.969656 24266 ts_manager.cc:81] Registered new tserver with Master: 265b79d01c454f83bf2fb4781b33418b (127.70.237.1:64036) 03:46:47.991 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:47.991029 24516 catalog_manager.cc:3544] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83: Generated new TSK 0 03:46:48.003 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.001729 24089 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e: No bootstrap required, opened a new log 03:46:48.003 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.003351 24089 raft_consensus.cc:287] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:48.004 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.003408 24089 raft_consensus.cc:313] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:48.004 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.004326 24089 raft_consensus.cc:576] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab65063aff344aa882efaffd4270f9e, State: Initialized, Role: FOLLOWER 03:46:48.004 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.004693 24089 consensus_queue.cc:190] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:48.016 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.016837 24089 sys_catalog.cc:321] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:48.017 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.017303 24089 sys_catalog.cc:324] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: This master's current role is: FOLLOWER 03:46:48.018 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.018426 24089 sys_catalog.cc:408] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: configured and running, proceeding with master startup. 03:46:48.021 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:48.021137 24170 leader_election.cc:353] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 election: Vote granted by peer 6ab65063aff344aa882efaffd4270f9e 03:46:48.021 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.019354 24045 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab65063aff344aa882efaffd4270f9e" 03:46:48.021 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.019503 24045 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [term 0 FOLLOWER]: Advancing to term 1 03:46:48.021 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.019628 24045 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e: Snoozing failure detection for 0.720s (vote granted) 03:46:48.021 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.020558 24045 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bf1c2c782eb45ecabaf02b6d6d71c83 in term 1. 03:46:48.040 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.040649 24611 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 03:46:48.048 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:48.048147 24296 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:48.061 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:48.061161 24296 tablet_server_main.cc:84] Starting tablet server... 03:46:48.091 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.091872 23941 master_main.cc:79] Master server successfully started. 03:46:48.092 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.091933 24043 raft_consensus.cc:964] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [term 1 FOLLOWER]: Refusing update from remote peer 1bf1c2c782eb45ecabaf02b6d6d71c83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:48.092 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:48.092770 24484 consensus_queue.cc:741] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [LEADER]: Connected to new peer: Peer: 6ab65063aff344aa882efaffd4270f9e, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:48.093 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.093431 24046 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ab65063aff344aa882efaffd4270f9e" is_pre_election: true 03:46:48.093 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.093514 24046 raft_consensus.cc:1923] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1bf1c2c782eb45ecabaf02b6d6d71c83 in term 1. Re-sending same reply. 03:46:48.094 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:48.094048 24170 leader_election.cc:353] T 00000000000000000000000000000000 P 1bf1c2c782eb45ecabaf02b6d6d71c83 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 6ab65063aff344aa882efaffd4270f9e 03:46:48.154 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.154233 24639 sys_catalog.cc:321] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bf1c2c782eb45ecabaf02b6d6d71c83. Latest consensus state: current_term: 1 leader_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:48.154 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.154266 24639 sys_catalog.cc:324] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: This master's current role is: FOLLOWER 03:46:48.155 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.155006 24600 sys_catalog.cc:321] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:48.155 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.155246 24600 sys_catalog.cc:324] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: This master's current role is: FOLLOWER 03:46:48.155 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.155611 24662 sys_catalog.cc:321] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ab65063aff344aa882efaffd4270f9e" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "1a5324bcd02b469f981db8c278cb16d5" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1bf1c2c782eb45ecabaf02b6d6d71c83" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:48.156 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.156045 24662 sys_catalog.cc:324] T 00000000000000000000000000000000 P 6ab65063aff344aa882efaffd4270f9e [sys.catalog]: This master's current role is: FOLLOWER 03:46:48.437 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.436650 24178 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64038 03:46:48.437 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.437031 24178 webserver.cc:149] Starting webserver on 127.70.237.1:64039 03:46:48.437 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.437047 24178 webserver.cc:160] Document root disabled 03:46:48.437 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.437527 24178 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64039/ 03:46:48.487 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.486778 24823 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:48.487 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.486944 24823 heartbeater.cc:387] Registering TS with master... 03:46:48.487 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.487360 24178 tablet_server_main.cc:87] Tablet server successfully started. 03:46:48.487 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.487344 24823 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:48.488 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:48.488291 24141 ts_manager.cc:81] Registered new tserver with Master: c60b08ee97c3491bb898ef6298493658 (127.70.237.1:64038) 03:46:48.489 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.489619 24025 ts_manager.cc:81] Registered new tserver with Master: c60b08ee97c3491bb898ef6298493658 (127.70.237.1:64038) 03:46:48.490 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.488644 24820 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:48.490 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.488690 24820 heartbeater.cc:387] Registering TS with master... 03:46:48.490 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.488839 24820 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:48.490 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.487291 24835 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:48.490 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.489099 24835 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:48.490 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.489109 24835 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:48.493 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.492866 24827 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:48.493 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.492914 24827 heartbeater.cc:387] Registering TS with master... 03:46:48.493 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:48.493065 24827 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:48.495 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:48.494086 24266 ts_manager.cc:81] Registered new tserver with Master: c60b08ee97c3491bb898ef6298493658 (127.70.237.1:64038) 03:46:48.496 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:48.495451 24266 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:57505 03:46:48.718 [INFO - main] (BaseKuduTest.java:117) Creating new Kudu client... 03:46:48.720 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 03:46:48.959 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:48.958964 24513 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:48.959 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:48.959025 24513 heartbeater.cc:387] Registering TS with master... 03:46:48.959 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:48.959201 24513 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:48.960 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:48.960377 24025 ts_manager.cc:81] Registered new tserver with Master: 265b79d01c454f83bf2fb4781b33418b (127.70.237.1:64036) 03:46:48.972 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:48.972232 24266 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:45736 03:46:49.068 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.068720 24296 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64040 03:46:49.069 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.069595 24296 webserver.cc:149] Starting webserver on 127.70.237.1:64041 03:46:49.069 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.069886 24296 webserver.cc:160] Document root disabled 03:46:49.070 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.070650 24296 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64041/ 03:46:49.131 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.130348 25062 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:49.131 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.130525 25062 heartbeater.cc:387] Registering TS with master... 03:46:49.131 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.130959 25062 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:49.132 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:49.132450 24025 ts_manager.cc:81] Registered new tserver with Master: 8131cd1a1d2c49e69f750b365d0687e0 (127.70.237.1:64040) 03:46:49.146 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.146111 25068 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:49.146 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.146189 25068 heartbeater.cc:387] Registering TS with master... 03:46:49.146 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.146359 25068 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:49.147 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:49.147555 24141 ts_manager.cc:81] Registered new tserver with Master: 8131cd1a1d2c49e69f750b365d0687e0 (127.70.237.1:64040) 03:46:49.152 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.152102 25073 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:49.152 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.152155 25073 heartbeater.cc:387] Registering TS with master... 03:46:49.152 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.152321 25073 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:49.152 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.152638 25079 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:49.152 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.152662 25079 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:49.152 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.152668 25079 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:49.154 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:49.153630 24266 ts_manager.cc:81] Registered new tserver with Master: 8131cd1a1d2c49e69f750b365d0687e0 (127.70.237.1:64040) 03:46:49.154 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:49.154486 24266 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:59939 03:46:49.156 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:49.156872 24296 tablet_server_main.cc:87] Tablet server successfully started. 03:46:49.498 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:49.497917 24827 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:49.709 [INFO - main] (BaseKuduTest.java:123) Waiting for tablet servers... 03:46:49.944 [DEBUG - New I/O worker #262] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:49.957 [DEBUG - New I/O worker #263] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:49.974 [DEBUG - New I/O worker #261] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:49.974 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:49.974756 24518 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:50.125 [DEBUG - New I/O worker #263] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 03:46:50.142 [DEBUG - New I/O worker #263] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=232), Traces: [0ms] querying master, [15ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64030, [16ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64032, [16ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64034, [180ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64032 response OK, [203ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64034 response OK, null) after lookup 03:46:50.150 [DEBUG - New I/O worker #263] (Deferred.java:1330) callback=retry RPC@1997219555 returned Deferred@1490192573(state=PENDING, result=null, callback=(continuation of Deferred@648609586 after retry RPC@1997219555), errback=(continuation of Deferred@648609586 after retry RPC@1997219555)), so the following Deferred is getting paused: Deferred@648609586(state=PAUSED, result=Deferred@1490192573, callback=wakeup thread main, errback=wakeup thread main) 03:46:50.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.156787 25073 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:50.204 [INFO - main] (BaseKuduTest.java:131) Creating table: org.apache.kudu.client.TestAsyncKuduSession-1505706385081 03:46:50.223 [DEBUG - New I/O worker #328] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:50.250 [DEBUG - New I/O worker #327] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:50.251 [DEBUG - New I/O worker #326] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:50.300 [DEBUG - New I/O worker #328] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 03:46:50.301 [DEBUG - New I/O worker #328] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=96), Traces: [0ms] querying master, [7ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64030, [8ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64032, [8ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64034, [95ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64034 response OK, null) after lookup 03:46:50.416 [DEBUG - New I/O worker #328] (Deferred.java:1330) callback=retry RPC@1162402507 returned Deferred@4873222(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after retry RPC@1162402507), errback=(continuation of Deferred@1245513949 after retry RPC@1162402507)), so the following Deferred is getting paused: Deferred@1245513949(state=PAUSED, result=Deferred@4873222, callback=org.apache.kudu.client.AsyncKuduClient$1@31007919 -> org.apache.kudu.client.AsyncKuduClient$2@329d7370 -> wakeup thread main, errback=passthrough -> passthrough -> wakeup thread main) 03:46:50.544 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:50.542209 24266 catalog_manager.cc:1211] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:41476: 03:46:50.544 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "org.apache.kudu.client.TestAsyncKuduSession-1505706385081" 03:46:50.544 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) schema { 03:46:50.544 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:50.544 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:50.544 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:50.544 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: true 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column1_i" 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column2_i" 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.545 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column3_s" 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: STRING 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: true 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) compression: LZ4 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 4096 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column4_b" 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: BOOL 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) partition_schema { 03:46:50.546 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) range_schema { 03:46:50.547 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:50.547 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:50.547 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.547 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.547 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:50.635 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@31007919@822114585 returned Deferred@1177352328(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@32e7e29 -> (continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$1@31007919@822114585), errback=passthrough -> (continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$1@31007919@822114585)), so the following Deferred is getting paused: Deferred@1245513949(state=PAUSED, result=Deferred@1177352328, callback=org.apache.kudu.client.AsyncKuduClient$2@329d7370 -> wakeup thread main, errback=passthrough -> wakeup thread main) 03:46:50.639 [DEBUG - New I/O worker #329] (AsyncKuduClient.java:571) Opened table 42556130c2f6445a8fa797efc3241bda 03:46:50.640 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504)), so the following Deferred is getting paused: Deferred@1245513949(state=PAUSED, result=Deferred@1796040423, callback=wakeup thread main, errback=wakeup thread main) 03:46:50.658 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480)), so the following Deferred is getting paused: Deferred@330201612(state=PAUSED, result=Deferred@1796040423, callback=, errback=) 03:46:50.674 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046)), so the following Deferred is getting paused: Deferred@1664874943(state=PAUSED, result=Deferred@1796040423, callback=, errback=) 03:46:50.693 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932)), so the following Deferred is getting paused: Deferred@145404932(state=PAUSED, result=Deferred@1796040423, callback=, errback=) 03:46:50.708 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.706939 24436 tablet_service.cc:764] Processing CreateTablet for tablet 8ff8d6a52bb04ccda026f32be3520914 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=42556130c2f6445a8fa797efc3241bda]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:50.714 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470)), so the following Deferred is getting paused: Deferred@1535501713(state=PAUSED, result=Deferred@1796040423, callback=, errback=) 03:46:50.716 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.716398 24436 ts_tablet_manager.cc:948] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: Registered tablet (data state: TABLET_DATA_READY) 03:46:50.732 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.730729 24814 tablet_service.cc:764] Processing CreateTablet for tablet 8ff8d6a52bb04ccda026f32be3520914 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=42556130c2f6445a8fa797efc3241bda]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:50.734 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470) -> (continuation of Deferred@1212203946 after org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470) -> (continuation of Deferred@1212203946 after org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832)), so the following Deferred is getting paused: Deferred@1212203946(state=PAUSED, result=Deferred@1796040423, callback=, errback=) 03:46:50.739 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.739462 24814 ts_tablet_manager.cc:948] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Registered tablet (data state: TABLET_DATA_READY) 03:46:50.743 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.740232 25300 ts_tablet_manager.cc:798] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: Bootstrapping tablet 03:46:50.743 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.740566 25300 tablet_bootstrap.cc:433] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: Bootstrap starting. 03:46:50.743 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.742357 25300 tablet_bootstrap.cc:568] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: No blocks or log segments found. Creating new log. 03:46:50.743 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.743113 25300 log.cc:518] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: Log is configured to *not* fsync() on all Append() calls 03:46:50.745 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.745929 25302 ts_tablet_manager.cc:798] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Bootstrapping tablet 03:46:50.746 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.746459 25302 tablet_bootstrap.cc:433] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Bootstrap starting. 03:46:50.754 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.754396 24570 tablet_service.cc:764] Processing CreateTablet for tablet 8ff8d6a52bb04ccda026f32be3520914 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=42556130c2f6445a8fa797efc3241bda]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:50.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.768671 25302 tablet_bootstrap.cc:568] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: No blocks or log segments found. Creating new log. 03:46:50.771 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.771260 25300 tablet_bootstrap.cc:433] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: No bootstrap required, opened a new log 03:46:50.771 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.771814 25300 ts_tablet_manager.cc:823] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s 03:46:50.773 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.773649 25302 log.cc:518] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Log is configured to *not* fsync() on all Append() calls 03:46:50.773 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@57e65d4a@1474714954 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470) -> (continuation of Deferred@1212203946 after org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832) -> (continuation of Deferred@591106890 after org.apache.kudu.client.AsyncKuduClient$12@57e65d4a@1474714954), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470) -> (continuation of Deferred@1212203946 after org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832) -> (continuation of Deferred@591106890 after org.apache.kudu.client.AsyncKuduClient$12@57e65d4a@1474714954)), so the following Deferred is getting paused: Deferred@591106890(state=PAUSED, result=Deferred@1796040423, callback=, errback=) 03:46:50.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.780002 25300 raft_consensus.cc:287] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8131cd1a1d2c49e69f750b365d0687e0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "265b79d01c454f83bf2fb4781b33418b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "c60b08ee97c3491bb898ef6298493658" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:50.780 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.780472 25300 raft_consensus.cc:313] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:50.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.781041 25300 raft_consensus.cc:576] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 265b79d01c454f83bf2fb4781b33418b, State: Initialized, Role: FOLLOWER 03:46:50.781 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.781370 25300 consensus_queue.cc:190] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:50.781 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.781582 25302 tablet_bootstrap.cc:433] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: No bootstrap required, opened a new log 03:46:50.782 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.782063 25302 ts_tablet_manager.cc:823] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.004s 03:46:50.783 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.783792 25302 raft_consensus.cc:287] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8131cd1a1d2c49e69f750b365d0687e0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "265b79d01c454f83bf2fb4781b33418b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "c60b08ee97c3491bb898ef6298493658" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:50.784 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.784060 25302 raft_consensus.cc:313] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:50.784 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.784570 25302 raft_consensus.cc:576] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8131cd1a1d2c49e69f750b365d0687e0, State: Initialized, Role: FOLLOWER 03:46:50.784 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.784852 25302 consensus_queue.cc:190] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:50.809 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.809253 25300 ts_tablet_manager.cc:851] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: Time spent starting tablet: real 0.037s user 0.004s sys 0.000s 03:46:50.814 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.814640 24570 ts_tablet_manager.cc:948] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: Registered tablet (data state: TABLET_DATA_READY) 03:46:50.827 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.827855 25302 ts_tablet_manager.cc:851] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Time spent starting tablet: real 0.046s user 0.000s sys 0.000s 03:46:50.833 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.829772 25311 ts_tablet_manager.cc:798] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: Bootstrapping tablet 03:46:50.833 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.830111 25311 tablet_bootstrap.cc:433] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: Bootstrap starting. 03:46:50.833 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.832048 25311 tablet_bootstrap.cc:568] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: No blocks or log segments found. Creating new log. 03:46:50.833 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.832911 25311 log.cc:518] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: Log is configured to *not* fsync() on all Append() calls 03:46:50.833 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@cff73aa@218067882 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470) -> (continuation of Deferred@1212203946 after org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832) -> (continuation of Deferred@591106890 after org.apache.kudu.client.AsyncKuduClient$12@57e65d4a@1474714954) -> (continuation of Deferred@1122810892 after org.apache.kudu.client.AsyncKuduClient$12@cff73aa@218067882), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470) -> (continuation of Deferred@1212203946 after org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832) -> (continuation of Deferred@591106890 after org.apache.kudu.client.AsyncKuduClient$12@57e65d4a@1474714954) -> (continuation of Deferred@1122810892 after org.apache.kudu.client.AsyncKuduClient$12@cff73aa@218067882)), so the following Deferred is getting paused: Deferred@1122810892(state=PAUSED, result=Deferred@1796040423, callback=, errback=) 03:46:50.850 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.847527 25308 raft_consensus.cc:412] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:50.850 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.847635 25308 raft_consensus.cc:2456] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Snoozing failure detection for 2.031s (starting election) 03:46:50.850 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.847769 25308 raft_consensus.cc:434] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8131cd1a1d2c49e69f750b365d0687e0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "265b79d01c454f83bf2fb4781b33418b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "c60b08ee97c3491bb898ef6298493658" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:50.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.848835 25308 leader_election.cc:221] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 265b79d01c454f83bf2fb4781b33418b 03:46:50.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.849138 25308 leader_election.cc:221] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer c60b08ee97c3491bb898ef6298493658 03:46:50.863 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.860851 25311 tablet_bootstrap.cc:433] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: No bootstrap required, opened a new log 03:46:50.863 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.861122 25311 ts_tablet_manager.cc:823] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s 03:46:50.863 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.862952 25311 raft_consensus.cc:287] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8131cd1a1d2c49e69f750b365d0687e0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "265b79d01c454f83bf2fb4781b33418b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "c60b08ee97c3491bb898ef6298493658" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:50.863 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.863028 25311 raft_consensus.cc:313] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:50.864 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.864037 25311 raft_consensus.cc:576] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c60b08ee97c3491bb898ef6298493658, State: Initialized, Role: FOLLOWER 03:46:50.864 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.864555 25311 consensus_queue.cc:190] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:50.869 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.869621 25311 ts_tablet_manager.cc:851] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s 03:46:50.877 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.876888 24631 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "8ff8d6a52bb04ccda026f32be3520914" candidate_uuid: "8131cd1a1d2c49e69f750b365d0687e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c60b08ee97c3491bb898ef6298493658" is_pre_election: true 03:46:50.877 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.877120 24631 raft_consensus.cc:2456] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: Snoozing failure detection for 1.886s (vote granted) 03:46:50.877 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.877204 24631 raft_consensus.cc:2010] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8131cd1a1d2c49e69f750b365d0687e0 in term 0. 03:46:50.878 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.878360 24553 leader_election.cc:353] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 pre-election: Vote granted by peer c60b08ee97c3491bb898ef6298493658 03:46:50.878 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.878428 24553 leader_election.cc:248] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:50.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.879139 25308 raft_consensus.cc:2456] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Snoozing failure detection for 1.604s (election complete) 03:46:50.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.879196 25308 raft_consensus.cc:2280] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:50.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.879238 25308 raft_consensus.cc:412] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:50.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.879251 25308 raft_consensus.cc:2456] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Snoozing failure detection for 1.643s (starting election) 03:46:50.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.879266 25308 raft_consensus.cc:2508] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 0 FOLLOWER]: Advancing to term 1 03:46:50.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.880331 25308 raft_consensus.cc:434] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8131cd1a1d2c49e69f750b365d0687e0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "265b79d01c454f83bf2fb4781b33418b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "c60b08ee97c3491bb898ef6298493658" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:50.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.880702 25308 leader_election.cc:221] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 election: Requesting vote from peer 265b79d01c454f83bf2fb4781b33418b 03:46:50.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.880827 25308 leader_election.cc:221] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 election: Requesting vote from peer c60b08ee97c3491bb898ef6298493658 03:46:50.883 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.882136 24631 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "8ff8d6a52bb04ccda026f32be3520914" candidate_uuid: "8131cd1a1d2c49e69f750b365d0687e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c60b08ee97c3491bb898ef6298493658" 03:46:50.883 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.882220 24631 raft_consensus.cc:2508] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658 [term 0 FOLLOWER]: Advancing to term 1 03:46:50.883 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.882330 24631 raft_consensus.cc:2456] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658: Snoozing failure detection for 1.999s (vote granted) 03:46:50.883 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:50.883234 24631 raft_consensus.cc:2010] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8131cd1a1d2c49e69f750b365d0687e0 in term 1. 03:46:50.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.884068 24553 leader_election.cc:353] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 election: Vote granted by peer c60b08ee97c3491bb898ef6298493658 03:46:50.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.884100 24553 leader_election.cc:248] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:50.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.884573 25308 raft_consensus.cc:2456] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0: Snoozing failure detection for 1.906s (election complete) 03:46:50.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.884614 25308 raft_consensus.cc:2280] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 1 FOLLOWER]: Leader election won for term 1 03:46:50.892 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.888705 25308 raft_consensus.cc:542] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [term 1 LEADER]: Becoming Leader. State: Replica: 8131cd1a1d2c49e69f750b365d0687e0, State: Running, Role: LEADER 03:46:50.892 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.889008 25308 consensus_queue.cc:169] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8131cd1a1d2c49e69f750b365d0687e0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "265b79d01c454f83bf2fb4781b33418b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "c60b08ee97c3491bb898ef6298493658" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } 03:46:50.902 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:50.902235 24264 catalog_manager.cc:2511] T 8ff8d6a52bb04ccda026f32be3520914 reported cstate change: term changed from 0 to 1, leader changed from to 8131cd1a1d2c49e69f750b365d0687e0 (127.70.237.1). New cstate: current_term: 1 leader_uuid: "8131cd1a1d2c49e69f750b365d0687e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8131cd1a1d2c49e69f750b365d0687e0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "265b79d01c454f83bf2fb4781b33418b" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } peers { permanent_uuid: "c60b08ee97c3491bb898ef6298493658" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } } 03:46:50.914 [DEBUG - New I/O worker #329] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@2785b516@663074070 returned Deferred@1796040423(state=PENDING, result=null, callback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470) -> (continuation of Deferred@1212203946 after org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832) -> (continuation of Deferred@591106890 after org.apache.kudu.client.AsyncKuduClient$12@57e65d4a@1474714954) -> (continuation of Deferred@1122810892 after org.apache.kudu.client.AsyncKuduClient$12@cff73aa@218067882) -> (continuation of Deferred@1490801519 after org.apache.kudu.client.AsyncKuduClient$12@2785b516@663074070), errback=(continuation of Deferred@1245513949 after org.apache.kudu.client.AsyncKuduClient$2@329d7370@849179504) -> (continuation of Deferred@330201612 after org.apache.kudu.client.AsyncKuduClient$12@32673c70@845626480) -> (continuation of Deferred@1664874943 after org.apache.kudu.client.AsyncKuduClient$12@63018166@1661043046) -> (continuation of Deferred@145404932 after org.apache.kudu.client.AsyncKuduClient$12@6834dd14@1748294932) -> (continuation of Deferred@1535501713 after org.apache.kudu.client.AsyncKuduClient$12@674f1ec6@1733238470) -> (continuation of Deferred@1212203946 after org.apache.kudu.client.AsyncKuduClient$12@15974f88@362237832) -> (continuation of Deferred@591106890 after org.apache.kudu.client.AsyncKuduClient$12@57e65d4a@1474714954) -> (continuation of Deferred@1122810892 after org.apache.kudu.client.AsyncKuduClient$12@cff73aa@218067882) -> (continuation of Deferred@1490801519 after org.apache.kudu.client.AsyncKuduClient$12@2785b516@663074070)), so the following Deferred is getting paused: Deferred@1490801519(state=PAUSED, result=Deferred@1796040423, callback=, errback=) 03:46:50.921 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.919946 24456 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "8ff8d6a52bb04ccda026f32be3520914" candidate_uuid: "8131cd1a1d2c49e69f750b365d0687e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "265b79d01c454f83bf2fb4781b33418b" is_pre_election: true 03:46:50.921 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.920171 24456 raft_consensus.cc:2456] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: Snoozing failure detection for 2.125s (vote granted) 03:46:50.921 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.920233 24456 raft_consensus.cc:2010] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8131cd1a1d2c49e69f750b365d0687e0 in term 0. 03:46:50.922 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.920670 24455 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "8ff8d6a52bb04ccda026f32be3520914" candidate_uuid: "8131cd1a1d2c49e69f750b365d0687e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "265b79d01c454f83bf2fb4781b33418b" 03:46:50.922 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.920727 24455 raft_consensus.cc:2508] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b [term 0 FOLLOWER]: Advancing to term 1 03:46:50.922 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.920821 24455 raft_consensus.cc:2456] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b: Snoozing failure detection for 2.169s (vote granted) 03:46:50.923 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:50.923044 24455 raft_consensus.cc:2010] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8131cd1a1d2c49e69f750b365d0687e0 in term 1. 03:46:50.923 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.922654 24548 leader_election.cc:353] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 265b79d01c454f83bf2fb4781b33418b 03:46:50.923 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:50.923684 24548 leader_election.cc:353] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [CANDIDATE]: Term 1 election: Vote granted by peer 265b79d01c454f83bf2fb4781b33418b 03:46:51.041 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@29d1f6e3, flushNotification=Deferred@770598657(state=PENDING, result=null, callback=, errback=)} 03:46:51.042 [DEBUG - New I/O worker #329] (AsyncKuduClient.java:1727) Learned about tablet 8ff8d6a52bb04ccda026f32be3520914 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:51.044 [DEBUG - New I/O worker #329] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=8ff8d6a52bb04ccda026f32be3520914, ttl=299999}] 03:46:51.046 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@68ecfcd8@1760361688 returned Deferred@2131628080(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1498322908 after org.apache.kudu.client.AsyncKuduSession$1@68ecfcd8@1760361688), errback=passthrough -> (continuation of Deferred@1498322908 after org.apache.kudu.client.AsyncKuduSession$1@68ecfcd8@1760361688)), so the following Deferred is getting paused: Deferred@1498322908(state=PAUSED, result=Deferred@2131628080, callback=, errback=) 03:46:51.105 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:51.105160 24631 raft_consensus.cc:964] T 8ff8d6a52bb04ccda026f32be3520914 P c60b08ee97c3491bb898ef6298493658 [term 1 FOLLOWER]: Refusing update from remote peer 8131cd1a1d2c49e69f750b365d0687e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:51.106 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:51.106534 25308 consensus_queue.cc:741] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [LEADER]: Connected to new peer: Peer: c60b08ee97c3491bb898ef6298493658, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:51.114 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:51.113561 24455 raft_consensus.cc:964] T 8ff8d6a52bb04ccda026f32be3520914 P 265b79d01c454f83bf2fb4781b33418b [term 1 FOLLOWER]: Refusing update from remote peer 8131cd1a1d2c49e69f750b365d0687e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:51.115 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:51.115022 25308 consensus_queue.cc:741] T 8ff8d6a52bb04ccda026f32be3520914 P 8131cd1a1d2c49e69f750b365d0687e0 [LEADER]: Connected to new peer: Peer: 265b79d01c454f83bf2fb4781b33418b, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:51.224 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 1 rows, more=false) 03:46:51.372 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:51.376 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:51.393 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:51.398 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:51.399 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=null, flushNotification=Deferred@122037659(state=PENDING, result=null, callback=, errback=)} 03:46:51.400 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@8c30397@146998167 returned Deferred@121838895(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@770598657 after org.apache.kudu.client.AsyncKuduSession$1@8c30397@146998167), errback=passthrough -> (continuation of Deferred@770598657 after org.apache.kudu.client.AsyncKuduSession$1@8c30397@146998167)), so the following Deferred is getting paused: Deferred@770598657(state=PAUSED, result=Deferred@121838895, callback=, errback=) 03:46:51.439 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:51.494 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:51.495 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2a9e9a6c, flushNotification=Deferred@474089561(state=PENDING, result=null, callback=, errback=)} 03:46:51.517 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:52.511 [DEBUG - Hashed wheel timer #6] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@46a8fb41, flushNotification=Deferred@1215241700(state=PENDING, result=null, callback=, errback=)} 03:46:52.573 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 11 rows, more=false) 03:46:52.591 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 31 rows, more=false) 03:46:52.613 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 03:46:52.623 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 03:46:52.623 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@210599933(state=PENDING, result=null, callback=, errback=)} 03:46:52.624 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@1338a126@322478374 returned Deferred@1303053527(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1215241700 after org.apache.kudu.client.AsyncKuduSession$1@1338a126@322478374), errback=passthrough -> (continuation of Deferred@1215241700 after org.apache.kudu.client.AsyncKuduSession$1@1338a126@322478374)), so the following Deferred is getting paused: Deferred@1215241700(state=PAUSED, result=Deferred@1303053527, callback=, errback=) 03:46:52.642 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:52.648 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:52.649 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@1093127675(state=PENDING, result=null, callback=, errback=)} 03:46:52.649 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@26b230b5@649212085 returned Deferred@1893045460(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@210599933 after org.apache.kudu.client.AsyncKuduSession$1@26b230b5@649212085), errback=passthrough -> (continuation of Deferred@210599933 after org.apache.kudu.client.AsyncKuduSession$1@26b230b5@649212085)), so the following Deferred is getting paused: Deferred@210599933(state=PAUSED, result=Deferred@1893045460, callback=, errback=) 03:46:52.662 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:52.760 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:52.762 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@654daba5, flushNotification=Deferred@452655842(state=PENDING, result=null, callback=, errback=)} 03:46:52.764 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2d7a4690, flushNotification=Deferred@1909785823(state=PENDING, result=null, callback=, errback=)} 03:46:52.778 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@79cd89c3, flushNotification=Deferred@883773938(state=PENDING, result=null, callback=, errback=)} 03:46:52.792 [DEBUG - New I/O worker #330] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@5b684c25@1533561893 returned Deferred@1521273086(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1909785823 after org.apache.kudu.client.AsyncKuduSession$1@5b684c25@1533561893), errback=passthrough -> (continuation of Deferred@1909785823 after org.apache.kudu.client.AsyncKuduSession$1@5b684c25@1533561893)), so the following Deferred is getting paused: Deferred@1909785823(state=PAUSED, result=Deferred@1521273086, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 03:46:52.814 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 21 rows, more=false) 03:46:52.820 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4b1ccf31, flushNotification=Deferred@313969009(state=PENDING, result=null, callback=, errback=)} 03:46:52.821 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7a0d975, flushNotification=Deferred@1499212466(state=PENDING, result=null, callback=, errback=)} 03:46:52.851 [DEBUG - New I/O worker #330] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@6a791003@1786318851 returned Deferred@576178785(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@313969009 after org.apache.kudu.client.AsyncKuduSession$1@6a791003@1786318851), errback=passthrough -> (continuation of Deferred@313969009 after org.apache.kudu.client.AsyncKuduSession$1@6a791003@1786318851)), so the following Deferred is getting paused: Deferred@313969009(state=PAUSED, result=Deferred@576178785, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 03:46:52.870 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:46:52.874 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:46:52.887 [DEBUG - New I/O worker #329] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:46:52.887 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1955857391(state=PENDING, result=null, callback=, errback=)} 03:46:52.889 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@50cda14d, flushNotification=Deferred@1361555792(state=PENDING, result=null, callback=, errback=)} 03:46:52.899 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6996187c, flushNotification=Deferred@1028253146(state=PENDING, result=null, callback=, errback=)} 03:46:52.910 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@b3ecf7, flushNotification=Deferred@1827827840(state=PENDING, result=null, callback=, errback=)} 03:46:52.918 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@357ec09a, flushNotification=Deferred@1198232794(state=PENDING, result=null, callback=, errback=)} 03:46:52.934 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@58201c94, flushNotification=Deferred@656998752(state=PENDING, result=null, callback=, errback=)} 03:46:52.949 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@64907f0f, flushNotification=Deferred@2135357955(state=PENDING, result=null, callback=, errback=)} 03:46:52.961 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@275a8dc3, flushNotification=Deferred@1217903177(state=PENDING, result=null, callback=, errback=)} 03:46:52.975 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2f18dc53, flushNotification=Deferred@1741077841(state=PENDING, result=null, callback=, errback=)} 03:46:52.987 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@148100ff, flushNotification=Deferred@1630643668(state=PENDING, result=null, callback=, errback=)} 03:46:53.007 [DEBUG - New I/O worker #330] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@3b47b36a@994554730 returned Deferred@126908356(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1741077841 after org.apache.kudu.client.AsyncKuduSession$1@3b47b36a@994554730), errback=passthrough -> (continuation of Deferred@1741077841 after org.apache.kudu.client.AsyncKuduSession$1@3b47b36a@994554730)), so the following Deferred is getting paused: Deferred@1741077841(state=PAUSED, result=Deferred@126908356, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 03:46:53.026 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:53.032 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1515982741(state=PENDING, result=null, callback=, errback=)} 03:46:53.033 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@46466ad9, flushNotification=Deferred@716536000(state=PENDING, result=null, callback=, errback=)} 03:46:53.059 [DEBUG - New I/O worker #331] (AsyncKuduClient.java:1727) Learned about tablet 8ff8d6a52bb04ccda026f32be3520914 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:53.059 [DEBUG - New I/O worker #331] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=8ff8d6a52bb04ccda026f32be3520914, ttl=299999}] 03:46:53.061 [DEBUG - New I/O worker #331] (AsyncKuduClient.java:1727) Learned about tablet 8ff8d6a52bb04ccda026f32be3520914 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:53.070 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@32b04f4c, flushNotification=Deferred@145415720(state=PENDING, result=null, callback=, errback=)} 03:46:53.094 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7dcf7d46, flushNotification=Deferred@2092788039(state=PENDING, result=null, callback=, errback=)} 03:46:53.106 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4c4793b3, flushNotification=Deferred@314724237(state=PENDING, result=null, callback=, errback=)} 03:46:53.124 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@146125de, flushNotification=Deferred@58822980(state=PENDING, result=null, callback=, errback=)} 03:46:53.131 [DEBUG - New I/O worker #331] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=8ff8d6a52bb04ccda026f32be3520914, ttl=299999}] 03:46:53.133 [DEBUG - New I/O worker #331] (AsyncKuduClient.java:1727) Learned about tablet 8ff8d6a52bb04ccda026f32be3520914 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:53.160 [DEBUG - New I/O worker #331] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=8ff8d6a52bb04ccda026f32be3520914, ttl=299999}] 03:46:53.145 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@73ab508c, flushNotification=Deferred@1930807123(state=PENDING, result=null, callback=, errback=)} 03:46:53.173 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6ec7533a, flushNotification=Deferred@1631843351(state=PENDING, result=null, callback=, errback=)} 03:46:53.187 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4845e783, flushNotification=Deferred@364355207(state=PENDING, result=null, callback=, errback=)} 03:46:53.196 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@413d5188, flushNotification=Deferred@1067513588(state=PENDING, result=null, callback=, errback=)} 03:46:53.209 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@58be777c, flushNotification=Deferred@1909758282(state=PENDING, result=null, callback=, errback=)} 03:46:53.221 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5ace37e9, flushNotification=Deferred@1658940690(state=PENDING, result=null, callback=, errback=)} 03:46:53.236 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@494fe3a5, flushNotification=Deferred@478428431(state=PENDING, result=null, callback=, errback=)} 03:46:53.248 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@375e2009, flushNotification=Deferred@1581142541(state=PENDING, result=null, callback=, errback=)} 03:46:53.259 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@685ad0a4, flushNotification=Deferred@1435231461(state=PENDING, result=null, callback=, errback=)} 03:46:53.288 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1313d835, flushNotification=Deferred@1066491488(state=PENDING, result=null, callback=, errback=)} 03:46:53.300 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@17066c6, flushNotification=Deferred@198579905(state=PENDING, result=null, callback=, errback=)} 03:46:53.317 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@609a5fe, flushNotification=Deferred@861833473(state=PENDING, result=null, callback=, errback=)} 03:46:53.330 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@311a8ffa, flushNotification=Deferred@172091142(state=PENDING, result=null, callback=, errback=)} 03:46:53.351 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1101825509(state=PENDING, result=null, callback=, errback=)} 03:46:53.359 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=28), No traces, null) with no deferred attached! 03:46:53.363 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@117250640(state=PENDING, result=null, callback=, errback=)} 03:46:53.371 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:53.375 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1677533226(state=PENDING, result=null, callback=, errback=)} 03:46:53.388 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=12), No traces, null) with no deferred attached! 03:46:53.393 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1711374980(state=PENDING, result=null, callback=, errback=)} 03:46:53.402 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:53.406 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1135063052(state=PENDING, result=null, callback=, errback=)} 03:46:53.415 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:53.419 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@761666994(state=PENDING, result=null, callback=, errback=)} 03:46:53.427 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:53.431 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@655397956(state=PENDING, result=null, callback=, errback=)} 03:46:53.442 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:46:53.447 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1307522944(state=PENDING, result=null, callback=, errback=)} 03:46:53.455 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=7), No traces, null) with no deferred attached! 03:46:53.459 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@859228641(state=PENDING, result=null, callback=, errback=)} 03:46:53.466 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=7), No traces, null) with no deferred attached! 03:46:53.471 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@782293432(state=PENDING, result=null, callback=, errback=)} 03:46:53.479 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:53.482 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@221366940(state=PENDING, result=null, callback=, errback=)} 03:46:53.492 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=9), No traces, null) with no deferred attached! 03:46:53.495 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@961986445(state=PENDING, result=null, callback=, errback=)} 03:46:53.510 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=14), No traces, null) with no deferred attached! 03:46:53.512 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1009389703(state=PENDING, result=null, callback=, errback=)} 03:46:53.522 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:46:53.525 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@351237027(state=PENDING, result=null, callback=, errback=)} 03:46:53.535 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=9), No traces, null) with no deferred attached! 03:46:53.537 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@394870408(state=PENDING, result=null, callback=, errback=)} 03:46:53.547 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:46:53.550 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@456081699(state=PENDING, result=null, callback=, errback=)} 03:46:53.563 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=12), No traces, null) with no deferred attached! 03:46:53.565 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2003682537(state=PENDING, result=null, callback=, errback=)} 03:46:53.574 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:46:53.575 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@410043340(state=PENDING, result=null, callback=, errback=)} 03:46:53.588 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=13), No traces, null) with no deferred attached! 03:46:53.590 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1179898676(state=PENDING, result=null, callback=, errback=)} 03:46:53.601 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:46:53.604 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@655668356(state=PENDING, result=null, callback=, errback=)} 03:46:53.615 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=12), No traces, null) with no deferred attached! 03:46:53.617 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1053255171(state=PENDING, result=null, callback=, errback=)} 03:46:53.628 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:46:53.630 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@548908212(state=PENDING, result=null, callback=, errback=)} 03:46:53.641 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:46:53.643 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2015695333(state=PENDING, result=null, callback=, errback=)} 03:46:53.655 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=13), No traces, null) with no deferred attached! 03:46:53.657 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2056731377(state=PENDING, result=null, callback=, errback=)} 03:46:53.675 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=17), No traces, null) with no deferred attached! 03:46:53.677 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2137373918(state=PENDING, result=null, callback=, errback=)} 03:46:53.688 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:46:53.690 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1646947722(state=PENDING, result=null, callback=, errback=)} 03:46:53.700 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=9), No traces, null) with no deferred attached! 03:46:53.702 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@852550163(state=PENDING, result=null, callback=, errback=)} 03:46:53.713 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:46:53.715 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1901266442(state=PENDING, result=null, callback=, errback=)} 03:46:53.724 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=9), No traces, null) with no deferred attached! 03:46:53.728 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@595773362(state=PENDING, result=null, callback=, errback=)} 03:46:53.737 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:46:53.741 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@309704821(state=PENDING, result=null, callback=, errback=)} 03:46:53.748 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=7), No traces, null) with no deferred attached! 03:46:53.752 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@662704210(state=PENDING, result=null, callback=, errback=)} 03:46:53.760 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=7), No traces, null) with no deferred attached! 03:46:53.769 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 50 rows, more=false) 03:46:53.770 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4e0a31fe, flushNotification=Deferred@2072039642(state=PENDING, result=null, callback=, errback=)} 03:46:53.780 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:46:53.785 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@440979cf, flushNotification=Deferred@1672278940(state=PENDING, result=null, callback=, errback=)} 03:46:53.794 [DEBUG - New I/O worker #330] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:46:53.801 [DEBUG - New I/O worker #330] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:46:53.812 [DEBUG - New I/O worker #331] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:46:53.812 [DEBUG - New I/O worker #326] (Connection.java:666) [peer master-127.70.237.1:64030] cleaning up while in state READY due to: connection disconnected 03:46:53.815 [DEBUG - New I/O worker #327] (Connection.java:666) [peer master-127.70.237.1:64032] cleaning up while in state READY due to: connection disconnected 03:46:53.819 [DEBUG - main] (Deferred.java:1330) callback=disconnect callback@889486595 returned Deferred@77269878(state=PENDING, result=null, callback=release resources callback -> (continuation of Deferred@1990160809 after disconnect callback@889486595), errback=passthrough -> (continuation of Deferred@1990160809 after disconnect callback@889486595)), so the following Deferred is getting paused: Deferred@1990160809(state=PAUSED, result=Deferred@77269878, callback=, errback=) 03:46:53.821 [DEBUG - New I/O worker #328] (Connection.java:666) [peer master-127.70.237.1:64034] cleaning up while in state READY due to: connection disconnected 03:46:53.821 [DEBUG - New I/O worker #330] (AsyncKuduClient.java:1872) Releasing all remaining resources 03:46:53.840 [DEBUG - New I/O worker #330] (Connection.java:666) [peer 8131cd1a1d2c49e69f750b365d0687e0] cleaning up while in state READY due to: connection disconnected 03:46:53.872 [DEBUG - New I/O worker #262] (Connection.java:666) [peer master-127.70.237.1:64032] cleaning up while in state READY due to: connection disconnected 03:46:53.886 [DEBUG - New I/O worker #263] (Connection.java:666) [peer master-127.70.237.1:64034] cleaning up while in state READY due to: connection disconnected 03:46:53.886 [DEBUG - New I/O worker #264] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:46:53.891 [DEBUG - New I/O worker #261] (Connection.java:666) [peer master-127.70.237.1:64030] cleaning up while in state READY due to: connection disconnected 03:46:53.958 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:53.958040 25068 heartbeater.cc:524] Failed to heartbeat to 127.70.237.1:64032: Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:53.958 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:53.958086 25062 heartbeater.cc:524] Failed to heartbeat to 127.70.237.1:64030: Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.70.237.1:64030: connect: Connection refused (error 111) 03:46:53.958 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:53.958299 25073 heartbeater.cc:524] Failed to heartbeat to 127.70.237.1:64034: Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.70.237.1:64034: connect: Connection refused (error 111) 03:46:53.962 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) *** Aborted at 1505706413 (unix time) try "date -d @1505706413" if you are using GNU date *** 03:46:53.993 [INFO - main] (BaseKuduTest.java:75) Setting up before class... 03:46:53.993 [INFO - main] (MiniKuduCluster.java:152) Starting 3 masters... 03:46:54.439 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:54.440 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:54.440 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:54.439541 25570 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:54.440 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:54.439846 25601 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:54.441 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:54.441427 25570 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:54.441 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:54.441462 25570 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:54.441 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:54.441612 25601 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:54.441 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:54.441471 25570 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:54.441 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:54.441503 25570 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.443306 25570 master_main.cc:66] Master server non-default flags: 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706413994/data 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706413994/data 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64030 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:54.443 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_port=64031 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --never_fsync=true 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.25570 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706413994/logs 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --logtostderr=true 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Master server version: 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build type DEBUG 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:54.444 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build id 9998 03:46:54.456 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:54.456542 25601 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:54.456 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:54.456941 25601 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:54.457 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0918 03:46:54.457159 25601 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:54.459 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.459705 25601 master_main.cc:66] Master server non-default flags: 03:46:54.459 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:54.459 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:54.459 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706413994/data 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706413994/data 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64032 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_port=64033 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --never_fsync=true 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.25601 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706413994/logs 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --logtostderr=true 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Master server version: 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:54.460 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build type DEBUG 03:46:54.461 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:54.461 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build id 9998 03:46:54.489 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.488890 25601 minidump.cc:237] Setting minidump size limit to 20M 03:46:54.526 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.526890 25570 minidump.cc:237] Setting minidump size limit to 20M 03:46:54.570 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.570375 25601 master_main.cc:73] Initializing master server... 03:46:54.571 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.571566 25601 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 451329 03:46:54.576 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.576396 25601 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706413994/data/instance: No such file or directory (error 2) 03:46:54.576 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.576728 25601 server_base.cc:229] Creating new FS layout 03:46:54.619 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.619734 25601 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706413994/data/instance: 03:46:54.620 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "9ed3771230f54282b31fb89f2b327140" 03:46:54.620 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:54 on jenkins-slave-c3oe" 03:46:54.636 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.636682 25570 master_main.cc:73] Initializing master server... 03:46:54.637 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.637818 25570 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 451329 03:46:54.642 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.642195 25570 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706413994/data/instance: No such file or directory (error 2) 03:46:54.642 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.642516 25570 server_base.cc:229] Creating new FS layout 03:46:54.647 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.647030 25570 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706413994/data/instance: 03:46:54.647 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "73c5434c29524bb59af82de3185e1c1d" 03:46:54.647 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:54 on jenkins-slave-c3oe" 03:46:54.651 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.651415 25601 fs_manager.cc:431] Time spent creating directory manager: real 0.031s user 0.004s sys 0.004s 03:46:54.652 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.652233 25601 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:54.652 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.652649 25601 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:54.664 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.664048 25601 fs_manager.cc:335] Time spent opening block manager: real 0.009s user 0.000s sys 0.004s 03:46:54.664 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.664604 25601 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706413994/data 03:46:54.664 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "9ed3771230f54282b31fb89f2b327140" 03:46:54.664 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:54 on jenkins-slave-c3oe" 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.665055 25601 fs_report.cc:347] Block manager report 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) -------------------- 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-1-1505706413994/data/data 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:54.665 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:54.822 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.822190 25570 fs_manager.cc:431] Time spent creating directory manager: real 0.174s user 0.008s sys 0.000s 03:46:54.823 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.823246 25570 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:54.823 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.823465 25570 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:54.845 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.845742 25570 fs_manager.cc:335] Time spent opening block manager: real 0.020s user 0.000s sys 0.004s 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.846276 25570 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706413994/data 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "73c5434c29524bb59af82de3185e1c1d" 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:54 on jenkins-slave-c3oe" 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:54.846678 25570 fs_report.cc:347] Block manager report 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) -------------------- 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-0-1505706413994/data/data 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:54.846 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:54.847 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:54.847 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:54.847 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:54.847 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:54.847 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:54.847 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:54.847 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:54.862 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:54.862 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:54.862200 25648 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:54.863 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:54.863541 25648 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 03:46:54.863 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:54.863575 25648 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:54.863 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:54.863584 25648 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 03:46:54.864 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:54.863613 25648 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:54.865 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.865483 25648 master_main.cc:66] Master server non-default flags: 03:46:54.865 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:54.865 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 03:46:54.865 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706413994/data 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706413994/data 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --master_addresses=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64034 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_port=64035 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --never_fsync=true 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.25648 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:54.866 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706413994/logs 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --logtostderr=true 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Master server version: 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build type DEBUG 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:54.867 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build id 9998 03:46:54.882 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.882722 25648 minidump.cc:237] Setting minidump size limit to 20M 03:46:54.929 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.929180 25601 master_main.cc:76] Starting Master server... 03:46:54.936 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.936669 25648 master_main.cc:73] Initializing master server... 03:46:54.936 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.936720 25682 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:54.937 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.936754 25682 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:54.937 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:54.936759 25682 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:54.937 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.937428 25648 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 451329 03:46:54.941 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.941746 25648 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706413994/data/instance: No such file or directory (error 2) 03:46:54.942 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.941787 25648 server_base.cc:229] Creating new FS layout 03:46:54.946 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.946033 25648 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706413994/data/instance: 03:46:54.946 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" 03:46:54.946 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:54 on jenkins-slave-c3oe" 03:46:54.964 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.964144 25648 fs_manager.cc:431] Time spent creating directory manager: real 0.018s user 0.004s sys 0.004s 03:46:54.964 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.964819 25648 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:54.965 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.965032 25648 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:54.969 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.969147 25648 fs_manager.cc:335] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s 03:46:54.969 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.969314 25648 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706413994/data 03:46:54.969 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" 03:46:54.969 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:54 on jenkins-slave-c3oe" 03:46:54.969 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:54.969391 25648 fs_report.cc:347] Block manager report 03:46:54.969 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) -------------------- 03:46:54.969 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/master-2-1505706413994/data/data 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:54.970 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:55.008 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.008816 25570 master_main.cc:76] Starting Master server... 03:46:55.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.009097 25717 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:55.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.009243 25717 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:55.009 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.009254 25717 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:55.014 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.014379 25570 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64030 03:46:55.014 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.014755 25570 webserver.cc:149] Starting webserver on 127.70.237.1:64031 03:46:55.014 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.014775 25570 webserver.cc:160] Document root disabled 03:46:55.015 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.015220 25570 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64031/ 03:46:55.021 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.021637 25765 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.026 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.026656 25648 master_main.cc:76] Starting Master server... 03:46:55.027 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.027182 25769 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:55.027 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.027370 25769 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:55.027 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.027439 25769 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:55.064 [INFO - main] (MiniKuduCluster.java:155) Starting 3 tablet servers... 03:46:55.121 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.121225 25765 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.157 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:55.157682 25765 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:55.220 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.219919 25765 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 1 03:46:55.221 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:55.221422 25765 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:55.278 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.278602 25765 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 2 03:46:55.280 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:55.279981 25765 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:55.300 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:55.301 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:55.300750 25794 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:55.302 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:55.302670 25794 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:55.305 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:55.305836 25794 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:55.306 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0918 03:46:55.306162 25794 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.308444 25794 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706415064/data 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706415064/data 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64036 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.25794 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:55.308 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706415064/logs 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type DEBUG 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:55.309 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 9998 03:46:55.320 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.320616 25794 minidump.cc:237] Setting minidump size limit to 20M 03:46:55.351 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.351166 25765 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 3 03:46:55.352 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:55.352744 25765 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:55.429 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.428685 25794 tablet_server_main.cc:79] Initializing tablet server... 03:46:55.429 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.429463 25794 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 451829 03:46:55.440 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.438113 25794 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706415064/data/instance: No such file or directory (error 2) 03:46:55.440 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.438148 25794 server_base.cc:229] Creating new FS layout 03:46:55.442 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.442749 25794 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706415064/data/instance: 03:46:55.442 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" 03:46:55.443 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:55 on jenkins-slave-c3oe" 03:46:55.504 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:55.504 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:55.503945 25852 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:55.505 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:55.505663 25852 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:55.505 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:55.505890 25852 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:55.506 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0918 03:46:55.506034 25852 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:55.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.503500 25794 fs_manager.cc:431] Time spent creating directory manager: real 0.059s user 0.008s sys 0.000s 03:46:55.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.504060 25794 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:55.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.504235 25794 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:55.507 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.507874 25852 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706415064/data 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706415064/data 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64038 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.25852 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706415064/logs 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:55.508 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type DEBUG 03:46:55.509 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:55.509 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 9998 03:46:55.520 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.519937 25765 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 4 03:46:55.521 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0918 03:46:55.521368 25765 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.520141 25794 fs_manager.cc:335] Time spent opening block manager: real 0.014s user 0.000s sys 0.000s 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.520295 25794 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706415064/data 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:55 on jenkins-slave-c3oe" 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.520366 25794 fs_report.cc:347] Block manager report 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-0-1505706415064/data/data 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:55.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:55.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:55.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:55.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:55.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:55.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:55.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:55.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:55.543 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.543417 25852 minidump.cc:237] Setting minidump size limit to 20M 03:46:55.645 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.645856 25852 tablet_server_main.cc:79] Initializing tablet server... 03:46:55.646 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.646476 25852 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 451829 03:46:55.703 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.702486 25648 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64034 03:46:55.703 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.702888 25648 webserver.cc:149] Starting webserver on 127.70.237.1:64035 03:46:55.704 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.702906 25648 webserver.cc:160] Document root disabled 03:46:55.704 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.703454 25648 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64035/ 03:46:55.710 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.705857 25852 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706415064/data/instance: No such file or directory (error 2) 03:46:55.710 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.705893 25852 server_base.cc:229] Creating new FS layout 03:46:55.711 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.711192 25794 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:55.719 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.719216 25897 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.724 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:55.724593 25794 tablet_server_main.cc:84] Starting tablet server... 03:46:55.728 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.728539 25852 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706415064/data/instance: 03:46:55.728 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "c804fbfdc126477889927ffc4b2c5373" 03:46:55.728 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:55 on jenkins-slave-c3oe" 03:46:55.739 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.739293 25897 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.747 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0918 03:46:55.747900 25897 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.70.237.1:64032: Network error: Client connection negotiation failed: client connection to 127.70.237.1:64032: connect: Connection refused (error 111) 03:46:55.772 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.769690 25852 fs_manager.cc:431] Time spent creating directory manager: real 0.036s user 0.004s sys 0.000s 03:46:55.773 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.770326 25852 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:55.773 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.770536 25852 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:55.775 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:55.774268 25601 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64032 03:46:55.775 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:55.774658 25601 webserver.cc:149] Starting webserver on 127.70.237.1:64033 03:46:55.775 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:55.774669 25601 webserver.cc:160] Document root disabled 03:46:55.775 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:55.775144 25601 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64033/ 03:46:55.792 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.790333 25852 fs_manager.cc:335] Time spent opening block manager: real 0.017s user 0.000s sys 0.000s 03:46:55.792 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.790503 25852 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706415064/data 03:46:55.792 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "c804fbfdc126477889927ffc4b2c5373" 03:46:55.792 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:55 on jenkins-slave-c3oe" 03:46:55.792 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.790573 25852 fs_report.cc:347] Block manager report 03:46:55.792 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 03:46:55.792 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-1-1505706415064/data/data 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:55.793 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:55.798 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.798574 25765 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 5 03:46:55.810 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.810458 25897 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } attempt: 1 03:46:55.812 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:55.812677 25929 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.817 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.817080 25852 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:55.817 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:55.817610 25852 tablet_server_main.cc:84] Starting tablet server... 03:46:55.838 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:55.838194 25929 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.864 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 03:46:55.880 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:55.864549 25901 flags.cc:395] Enabled unsafe flag: --never_fsync=true 03:46:55.882 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:55.882192 25901 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 03:46:55.882 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:55.882494 25901 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 03:46:55.882 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0918 03:46:55.882630 25901 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.70.237.1 03:46:55.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:55.884538 25901 tablet_server_main.cc:72] Tablet server non-default flags: 03:46:55.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 03:46:55.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706415064/data 03:46:55.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706415064/data 03:46:55.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 03:46:55.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.70.237.1:64040 03:46:55.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.70.237.1 03:46:55.884 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.70.237.1:64030,127.70.237.1:64032,127.70.237.1:64034 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.25901 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.70.237.1 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/3/java/kudu-client/target/test-classes/flags 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706415064/logs 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 4dfb33a1d452b0be9fded10838be10e7d026e87e 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type DEBUG 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 18 Sep 2017 03:34:31 UTC on jenkins-slave-c3oe 03:46:55.885 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 9998 03:46:55.917 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:55.916719 25901 minidump.cc:237] Setting minidump size limit to 20M 03:46:55.929 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:55.929577 25765 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.939 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:55.939173 25897 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.944 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:55.944403 25929 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 03:46:55.969 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:55.968654 25901 tablet_server_main.cc:79] Initializing tablet server... 03:46:55.969 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:55.969477 25901 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 451829 03:46:55.976 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:55.972862 25901 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706415064/data/instance: No such file or directory (error 2) 03:46:55.976 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:55.972892 25901 server_base.cc:229] Creating new FS layout 03:46:55.977 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:55.977335 25901 fs_manager.cc:474] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706415064/data/instance: 03:46:55.977 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "5523597a5ba64da387c3f0b472f8efd7" 03:46:55.977 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:55 on jenkins-slave-c3oe" 03:46:56.018 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:56.018769 25901 fs_manager.cc:431] Time spent creating directory manager: real 0.041s user 0.008s sys 0.000s 03:46:56.019 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:56.019718 25901 env_posix.cc:1589] Not raising process file limit of 65536; it is already as high as it can go 03:46:56.020 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:56.020170 25901 file_cache.cc:469] Constructed file cache lbm with capacity 26214 03:46:56.029 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.027748 25929 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140: Bootstrap starting. 03:46:56.031 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.030251 25929 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140: No blocks or log segments found. Creating new log. 03:46:56.031 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.031651 25929 log.cc:518] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140: Log is configured to *not* fsync() on all Append() calls 03:46:56.038 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 03:46:56.048 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.047047 25897 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Bootstrap starting. 03:46:56.056 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.053372 25765 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d: Bootstrap starting. 03:46:56.056 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.055366 25765 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d: No blocks or log segments found. Creating new log. 03:46:56.056 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.056180 25765 log.cc:518] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d: Log is configured to *not* fsync() on all Append() calls 03:46:56.061 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.061815 25929 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140: No bootstrap required, opened a new log 03:46:56.063 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.063421 25929 raft_consensus.cc:287] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:56.063 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.063829 25929 raft_consensus.cc:313] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:56.064 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.064514 25929 raft_consensus.cc:576] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed3771230f54282b31fb89f2b327140, State: Initialized, Role: FOLLOWER 03:46:56.064 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.064905 25929 consensus_queue.cc:190] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:56.065 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.065656 25929 sys_catalog.cc:321] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.065 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.065812 25929 sys_catalog.cc:324] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.066 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.066491 25929 sys_catalog.cc:408] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: configured and running, proceeding with master startup. 03:46:56.066 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.066891 25601 master_main.cc:79] Master server successfully started. 03:46:56.067 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.067085 26137 sys_catalog.cc:321] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.067 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.067191 26137 sys_catalog.cc:324] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.076 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.076934 25765 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d: No bootstrap required, opened a new log 03:46:56.078 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.078409 25765 raft_consensus.cc:287] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:56.078 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.078594 25765 raft_consensus.cc:313] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:56.078 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.078882 25765 raft_consensus.cc:576] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c5434c29524bb59af82de3185e1c1d, State: Initialized, Role: FOLLOWER 03:46:56.079 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.079018 25765 consensus_queue.cc:190] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:56.080 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.076697 25897 tablet_bootstrap.cc:568] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: No blocks or log segments found. Creating new log. 03:46:56.081 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.077447 25897 log.cc:518] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Log is configured to *not* fsync() on all Append() calls 03:46:56.109 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.109484 25897 tablet_bootstrap.cc:433] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: No bootstrap required, opened a new log 03:46:56.111 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.111057 25897 raft_consensus.cc:287] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:56.111 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.111291 25897 raft_consensus.cc:313] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:56.111 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.111611 25897 raft_consensus.cc:576] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c33b3fd52ae4ff1b3370f3dd2f07fa0, State: Initialized, Role: FOLLOWER 03:46:56.111 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.111769 25897 consensus_queue.cc:190] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:56.117 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:56.117615 25901 fs_manager.cc:335] Time spent opening block manager: real 0.095s user 0.000s sys 0.000s 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:56.118044 25901 fs_manager.cc:348] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706415064/data 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "5523597a5ba64da387c3f0b472f8efd7" 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-18 03:46:55 on jenkins-slave-c3oe" 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:56.118276 25901 fs_report.cc:347] Block manager report 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/3/build/test-tmp/ts-2-1505706415064/data/data 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 03:46:56.118 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 03:46:56.141 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.141090 25765 sys_catalog.cc:321] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.142 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.141129 25765 sys_catalog.cc:324] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.142 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.141821 25765 sys_catalog.cc:408] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: configured and running, proceeding with master startup. 03:46:56.146 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.146756 26143 sys_catalog.cc:321] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.147 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.147085 26143 sys_catalog.cc:324] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.151 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.151196 25897 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.151 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.151453 25897 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.152 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.152750 25897 sys_catalog.cc:408] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [sys.catalog]: configured and running, proceeding with master startup. 03:46:56.156 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.156810 26153 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.157 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.157037 26153 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.157 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.157217 26153 raft_consensus.cc:412] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:56.157 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.157351 26153 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Snoozing failure detection for 0.692s (starting election) 03:46:56.157 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.157479 26153 raft_consensus.cc:434] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:56.158 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.158154 26153 leader_election.cc:221] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 73c5434c29524bb59af82de3185e1c1d 03:46:56.159 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.159131 26153 leader_election.cc:221] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 9ed3771230f54282b31fb89f2b327140 03:46:56.160 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.160501 25846 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed3771230f54282b31fb89f2b327140" is_pre_election: true 03:46:56.160 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.160676 25570 master_main.cc:79] Master server successfully started. 03:46:56.160 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.160677 25846 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140: Snoozing failure detection for 0.759s (vote granted) 03:46:56.160 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.160719 25846 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c33b3fd52ae4ff1b3370f3dd2f07fa0 in term 0. 03:46:56.162 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.161641 25739 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c5434c29524bb59af82de3185e1c1d" is_pre_election: true 03:46:56.162 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.161778 25739 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d: Snoozing failure detection for 0.814s (vote granted) 03:46:56.162 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.161813 25739 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c33b3fd52ae4ff1b3370f3dd2f07fa0 in term 0. 03:46:56.162 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.162394 25706 leader_election.cc:353] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 9ed3771230f54282b31fb89f2b327140 03:46:56.162 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.162430 25706 leader_election.cc:248] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:56.162 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.162739 25708 leader_election.cc:353] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 73c5434c29524bb59af82de3185e1c1d 03:46:56.163 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.163144 26153 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Snoozing failure detection for 0.810s (election complete) 03:46:56.163 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.163266 26153 raft_consensus.cc:2280] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:56.163 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.163354 26153 raft_consensus.cc:412] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:56.163 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.163421 26153 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Snoozing failure detection for 0.734s (starting election) 03:46:56.163 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.163488 26153 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 0 FOLLOWER]: Advancing to term 1 03:46:56.164 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.164319 26153 raft_consensus.cc:434] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:56.164 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.164703 26153 leader_election.cc:221] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 election: Requesting vote from peer 73c5434c29524bb59af82de3185e1c1d 03:46:56.166 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.165310 25739 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c5434c29524bb59af82de3185e1c1d" 03:46:56.166 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.165385 25739 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [term 0 FOLLOWER]: Advancing to term 1 03:46:56.166 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.165459 25739 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d: Snoozing failure detection for 0.849s (vote granted) 03:46:56.166 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.166317 25739 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c33b3fd52ae4ff1b3370f3dd2f07fa0 in term 1. 03:46:56.166 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.166846 25708 leader_election.cc:353] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 election: Vote granted by peer 73c5434c29524bb59af82de3185e1c1d 03:46:56.167 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.166877 25708 leader_election.cc:248] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:56.167 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.167145 26153 leader_election.cc:221] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 election: Requesting vote from peer 9ed3771230f54282b31fb89f2b327140 03:46:56.167 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.167701 25846 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed3771230f54282b31fb89f2b327140" 03:46:56.167 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.167778 25846 raft_consensus.cc:2508] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [term 0 FOLLOWER]: Advancing to term 1 03:46:56.168 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.167845 25846 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140: Snoozing failure detection for 0.778s (vote granted) 03:46:56.168 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.168143 26153 raft_consensus.cc:2456] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Snoozing failure detection for 0.638s (election complete) 03:46:56.168 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.168249 26153 raft_consensus.cc:2280] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 1 FOLLOWER]: Leader election won for term 1 03:46:56.168 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.168370 26153 raft_consensus.cc:542] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [term 1 LEADER]: Becoming Leader. State: Replica: 1c33b3fd52ae4ff1b3370f3dd2f07fa0, State: Running, Role: LEADER 03:46:56.168 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.168613 26153 consensus_queue.cc:169] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } 03:46:56.169 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.168906 25846 raft_consensus.cc:2010] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c33b3fd52ae4ff1b3370f3dd2f07fa0 in term 1. 03:46:56.169 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.169664 25706 leader_election.cc:353] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [CANDIDATE]: Term 1 election: Vote granted by peer 9ed3771230f54282b31fb89f2b327140 03:46:56.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.172389 25852 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64038 03:46:56.172 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.172952 25852 webserver.cc:149] Starting webserver on 127.70.237.1:64039 03:46:56.173 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.173086 25852 webserver.cc:160] Document root disabled 03:46:56.173 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.173626 25852 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64039/ 03:46:56.176 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.176632 25648 master_main.cc:79] Master server successfully started. 03:46:56.176 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.176677 26184 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:56.176 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.176903 26184 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:56.177 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.176765 25852 tablet_server_main.cc:87] Tablet server successfully started. 03:46:56.177 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.176985 26184 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:56.177 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.177830 26164 sys_catalog.cc:321] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c33b3fd52ae4ff1b3370f3dd2f07fa0. Latest consensus state: current_term: 1 leader_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.178 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.177994 26164 sys_catalog.cc:324] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [sys.catalog]: This master's current role is: LEADER 03:46:56.190 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.190476 26185 catalog_manager.cc:948] Loading table and tablet metadata into memory... 03:46:56.218 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.218456 26185 catalog_manager.cc:959] Initializing Kudu internal certificate authority... 03:46:56.236 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.235513 26178 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:56.236 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.235638 26178 heartbeater.cc:387] Registering TS with master... 03:46:56.236 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.235929 26178 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:56.237 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.237241 25729 ts_manager.cc:81] Registered new tserver with Master: c804fbfdc126477889927ffc4b2c5373 (127.70.237.1:64038) 03:46:56.273 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.272708 26182 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:56.273 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.272766 26182 heartbeater.cc:387] Registering TS with master... 03:46:56.273 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.272917 26182 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:56.273 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.272936 26179 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:56.273 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.272972 26179 heartbeater.cc:387] Registering TS with master... 03:46:56.273 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:56.273072 26179 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:56.274 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.273844 25697 ts_manager.cc:81] Registered new tserver with Master: c804fbfdc126477889927ffc4b2c5373 (127.70.237.1:64038) 03:46:56.274 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.274292 25780 ts_manager.cc:81] Registered new tserver with Master: c804fbfdc126477889927ffc4b2c5373 (127.70.237.1:64038) 03:46:56.335 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.335232 25846 raft_consensus.cc:964] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [term 1 FOLLOWER]: Refusing update from remote peer 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) 03:46:56.336 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.336012 26164 consensus_queue.cc:741] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [LEADER]: Connected to new peer: Peer: 9ed3771230f54282b31fb89f2b327140, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:56.369 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.369691 25739 raft_consensus.cc:964] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [term 1 FOLLOWER]: Refusing update from remote peer 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) 03:46:56.370 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.370154 26137 sys_catalog.cc:321] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c33b3fd52ae4ff1b3370f3dd2f07fa0. Latest consensus state: current_term: 1 leader_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.370 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.370352 26137 sys_catalog.cc:324] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.370 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.370558 26164 consensus_queue.cc:741] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0 [LEADER]: Connected to new peer: Peer: 73c5434c29524bb59af82de3185e1c1d, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:56.373 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.373006 26137 sys_catalog.cc:321] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.373 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.373042 26137 sys_catalog.cc:324] T 00000000000000000000000000000000 P 9ed3771230f54282b31fb89f2b327140 [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.397 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.397074 26143 sys_catalog.cc:321] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c33b3fd52ae4ff1b3370f3dd2f07fa0. Latest consensus state: current_term: 1 leader_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.397 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.397116 26143 sys_catalog.cc:324] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.399 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.399519 26143 sys_catalog.cc:321] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c5434c29524bb59af82de3185e1c1d" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64030 } } peers { permanent_uuid: "9ed3771230f54282b31fb89f2b327140" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64032 } } peers { permanent_uuid: "1c33b3fd52ae4ff1b3370f3dd2f07fa0" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64034 } } } 03:46:56.399 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.399550 26143 sys_catalog.cc:324] T 00000000000000000000000000000000 P 73c5434c29524bb59af82de3185e1c1d [sys.catalog]: This master's current role is: FOLLOWER 03:46:56.431 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:56.431371 25901 ts_tablet_manager.cc:216] Loaded tablet metadata (0 live tablets) 03:46:56.444 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:56.444545 25901 tablet_server_main.cc:84] Starting tablet server... 03:46:56.802 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.798050 26185 catalog_manager.cc:846] Generated new certificate authority record 03:46:56.802 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.798938 26185 catalog_manager.cc:968] Loading token signing keys... 03:46:56.837 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.837314 26185 catalog_manager.cc:3544] T 00000000000000000000000000000000 P 1c33b3fd52ae4ff1b3370f3dd2f07fa0: Generated new TSK 0 03:46:56.878 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.876715 25794 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64036 03:46:56.878 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.877214 25794 webserver.cc:149] Starting webserver on 127.70.237.1:64037 03:46:56.878 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.877236 25794 webserver.cc:160] Document root disabled 03:46:56.878 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.877882 25794 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64037/ 03:46:56.914 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.913753 26391 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:56.914 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.913903 26391 heartbeater.cc:387] Registering TS with master... 03:46:56.914 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.914218 26391 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:56.915 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:56.915390 25697 ts_manager.cc:81] Registered new tserver with Master: b5d15f8d44784beaa17f6a2b9d44c68f (127.70.237.1:64036) 03:46:56.917 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.917258 26389 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:56.917 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.917315 26389 heartbeater.cc:387] Registering TS with master... 03:46:56.917 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.917467 26389 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:56.918 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:56.918149 25729 ts_manager.cc:81] Registered new tserver with Master: b5d15f8d44784beaa17f6a2b9d44c68f (127.70.237.1:64036) 03:46:56.928 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.928341 26395 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:56.928 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.928746 26395 heartbeater.cc:387] Registering TS with master... 03:46:56.929 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.929023 26395 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:56.930 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.929661 25780 ts_manager.cc:81] Registered new tserver with Master: b5d15f8d44784beaa17f6a2b9d44c68f (127.70.237.1:64036) 03:46:56.930 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:56.930546 25780 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:60825 03:46:56.932 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.932641 25794 tablet_server_main.cc:87] Tablet server successfully started. 03:46:56.936 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.932571 26401 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:56.936 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.936712 26401 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:56.940 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:56.940488 26401 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:57.021 [INFO - main] (BaseKuduTest.java:117) Creating new Kudu client... 03:46:57.022 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 03:46:57.276 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:57.276274 25780 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:45580 03:46:57.932 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:57.932356 26395 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:58.185 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.184648 25901 rpc_server.cc:192] RPC server started. Bound to: 127.70.237.1:64040 03:46:58.185 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.185072 25901 webserver.cc:149] Starting webserver on 127.70.237.1:64041 03:46:58.186 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.185086 25901 webserver.cc:160] Document root disabled 03:46:58.186 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.185614 25901 webserver.cc:282] Webserver started. Bound to: http://127.70.237.1:64041/ 03:46:58.224 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.224519 25901 tablet_server_main.cc:87] Tablet server successfully started. 03:46:58.224 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.224923 26645 process_memory.cc:181] Process hard memory limit is 94.627029 GB 03:46:58.225 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.225271 26645 process_memory.cc:183] Process soft memory limit is 75.701622 GB 03:46:58.225 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.225499 26645 process_memory.cc:186] Process memory pressure threshold is 56.776218 GB 03:46:58.265 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.264881 26639 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64032 03:46:58.265 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.265046 26639 heartbeater.cc:387] Registering TS with master... 03:46:58.266 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.265429 26639 heartbeater.cc:414] Master 127.70.237.1:64032 requested a full tablet report, sending... 03:46:58.266 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0918 03:46:58.266784 25697 ts_manager.cc:81] Registered new tserver with Master: 5523597a5ba64da387c3f0b472f8efd7 (127.70.237.1:64040) 03:46:58.272 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.272861 26636 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64030 03:46:58.273 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.272923 26636 heartbeater.cc:387] Registering TS with master... 03:46:58.273 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.273085 26636 heartbeater.cc:414] Master 127.70.237.1:64030 requested a full tablet report, sending... 03:46:58.273 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0918 03:46:58.273692 25729 ts_manager.cc:81] Registered new tserver with Master: 5523597a5ba64da387c3f0b472f8efd7 (127.70.237.1:64040) 03:46:58.275 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.275108 26640 heartbeater.cc:317] Connected to a master server at 127.70.237.1:64034 03:46:58.275 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.275153 26640 heartbeater.cc:387] Registering TS with master... 03:46:58.275 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.275298 26640 heartbeater.cc:414] Master 127.70.237.1:64034 requested a full tablet report, sending... 03:46:58.276 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:58.275779 25780 ts_manager.cc:81] Registered new tserver with Master: 5523597a5ba64da387c3f0b472f8efd7 (127.70.237.1:64040) 03:46:58.276 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:58.276584 25780 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.70.237.1:60974 03:46:58.278 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:58.278304 26182 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:58.297 [INFO - main] (BaseKuduTest.java:123) Waiting for tablet servers... 03:46:58.518 [DEBUG - New I/O worker #391] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:58.519 [DEBUG - New I/O worker #392] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:58.521 [DEBUG - New I/O worker #393] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:58.630 [DEBUG - New I/O worker #393] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 03:46:58.634 [DEBUG - New I/O worker #393] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=136), Traces: [0ms] querying master, [15ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64030, [16ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64032, [16ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64034, [116ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64032 response OK, [132ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64034 response OK, [136ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64030 response OK, null) after lookup 03:46:58.675 [DEBUG - New I/O worker #393] (Deferred.java:1330) callback=retry RPC@1992773749 returned Deferred@1882642229(state=PENDING, result=null, callback=(continuation of Deferred@237374775 after retry RPC@1992773749), errback=(continuation of Deferred@237374775 after retry RPC@1992773749)), so the following Deferred is getting paused: Deferred@237374775(state=PAUSED, result=Deferred@1882642229, callback=wakeup thread main, errback=wakeup thread main) 03:46:58.681 [INFO - main] (BaseKuduTest.java:131) Creating table: org.apache.kudu.client.TestAsyncKuduSession-1505706385081 03:46:58.686 [DEBUG - New I/O worker #458] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:58.716 [DEBUG - New I/O worker #457] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:58.725 [DEBUG - New I/O worker #456] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.70.237.1 03:46:58.738 [DEBUG - New I/O worker #458] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 03:46:58.738 [DEBUG - New I/O worker #458] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=57), Traces: [0ms] querying master, [1ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64030, [1ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64032, [1ms] Sub rpc: ConnectToMaster sending RPC to server master-127.70.237.1:64034, [47ms] Sub rpc: ConnectToMaster received from server master-127.70.237.1:64034 response OK, null) after lookup 03:46:58.752 [DEBUG - New I/O worker #458] (Deferred.java:1330) callback=retry RPC@53903687 returned Deferred@1177816901(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after retry RPC@53903687), errback=(continuation of Deferred@945146598 after retry RPC@53903687)), so the following Deferred is getting paused: Deferred@945146598(state=PAUSED, result=Deferred@1177816901, callback=org.apache.kudu.client.AsyncKuduClient$1@77380a67 -> org.apache.kudu.client.AsyncKuduClient$2@40b3917e -> wakeup thread main, errback=passthrough -> passthrough -> wakeup thread main) 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:58.777251 25780 catalog_manager.cc:1211] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:41489: 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "org.apache.kudu.client.TestAsyncKuduSession-1505706385081" 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) schema { 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: true 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:58.780 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column1_i" 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column2_i" 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column3_s" 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: STRING 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: true 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) compression: LZ4 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 4096 03:46:58.781 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column4_b" 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: BOOL 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) partition_schema { 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) range_schema { 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.782 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 03:46:58.835 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@77380a67@2000161383 returned Deferred@994497520(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@7e444afc -> (continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$1@77380a67@2000161383), errback=passthrough -> (continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$1@77380a67@2000161383)), so the following Deferred is getting paused: Deferred@945146598(state=PAUSED, result=Deferred@994497520, callback=org.apache.kudu.client.AsyncKuduClient$2@40b3917e -> wakeup thread main, errback=passthrough -> wakeup thread main) 03:46:58.837 [DEBUG - New I/O worker #459] (AsyncKuduClient.java:571) Opened table 14f87eb73bb44e3fba3dae8d59970d08 03:46:58.837 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014)), so the following Deferred is getting paused: Deferred@945146598(state=PAUSED, result=Deferred@989501196, callback=wakeup thread main, errback=wakeup thread main) 03:46:58.870 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596)), so the following Deferred is getting paused: Deferred@1118049457(state=PAUSED, result=Deferred@989501196, callback=, errback=) 03:46:58.884 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347)), so the following Deferred is getting paused: Deferred@1892090757(state=PAUSED, result=Deferred@989501196, callback=, errback=) 03:46:58.906 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030)), so the following Deferred is getting paused: Deferred@1503674307(state=PAUSED, result=Deferred@989501196, callback=, errback=) 03:46:58.912 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.911512 26458 tablet_service.cc:764] Processing CreateTablet for tablet b6b86156e9b74d87be85b30cdb0c6c38 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=14f87eb73bb44e3fba3dae8d59970d08]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:58.912 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:58.911514 26006 tablet_service.cc:764] Processing CreateTablet for tablet b6b86156e9b74d87be85b30cdb0c6c38 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=14f87eb73bb44e3fba3dae8d59970d08]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:58.922 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:58.922210 26116 tablet_service.cc:764] Processing CreateTablet for tablet b6b86156e9b74d87be85b30cdb0c6c38 (table=org.apache.kudu.client.TestAsyncKuduSession-1505706385081 [id=14f87eb73bb44e3fba3dae8d59970d08]), partition=RANGE (key) PARTITION UNBOUNDED 03:46:58.923 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545)), so the following Deferred is getting paused: Deferred@1379282051(state=PAUSED, result=Deferred@989501196, callback=, errback=) 03:46:58.938 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:58.937974 26006 ts_tablet_manager.cc:948] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: Registered tablet (data state: TABLET_DATA_READY) 03:46:58.938 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.937973 26458 ts_tablet_manager.cc:948] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Registered tablet (data state: TABLET_DATA_READY) 03:46:58.944 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545) -> (continuation of Deferred@754559933 after org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545) -> (continuation of Deferred@754559933 after org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662)), so the following Deferred is getting paused: Deferred@754559933(state=PAUSED, result=Deferred@989501196, callback=, errback=) 03:46:58.956 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:58.956598 26713 ts_tablet_manager.cc:798] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: Bootstrapping tablet 03:46:58.957 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:58.957280 26713 tablet_bootstrap.cc:433] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: Bootstrap starting. 03:46:58.959 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:58.959379 26713 tablet_bootstrap.cc:568] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: No blocks or log segments found. Creating new log. 03:46:58.960 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:58.960387 26713 log.cc:518] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: Log is configured to *not* fsync() on all Append() calls 03:46:58.964 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:58.964084 26116 ts_tablet_manager.cc:948] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: Registered tablet (data state: TABLET_DATA_READY) 03:46:58.964 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@181367cc@403924940 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545) -> (continuation of Deferred@754559933 after org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662) -> (continuation of Deferred@2074215033 after org.apache.kudu.client.AsyncKuduClient$12@181367cc@403924940), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545) -> (continuation of Deferred@754559933 after org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662) -> (continuation of Deferred@2074215033 after org.apache.kudu.client.AsyncKuduClient$12@181367cc@403924940)), so the following Deferred is getting paused: Deferred@2074215033(state=PAUSED, result=Deferred@989501196, callback=, errback=) 03:46:58.974 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.974272 26715 ts_tablet_manager.cc:798] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Bootstrapping tablet 03:46:58.974 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.974920 26715 tablet_bootstrap.cc:433] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Bootstrap starting. 03:46:58.977 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.977502 26715 tablet_bootstrap.cc:568] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: No blocks or log segments found. Creating new log. 03:46:58.978 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:58.978725 26715 log.cc:518] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Log is configured to *not* fsync() on all Append() calls 03:46:59.001 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:58.998183 26718 ts_tablet_manager.cc:798] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: Bootstrapping tablet 03:46:59.001 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:58.998561 26718 tablet_bootstrap.cc:433] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: Bootstrap starting. 03:46:59.001 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.000511 26718 tablet_bootstrap.cc:568] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: No blocks or log segments found. Creating new log. 03:46:59.001 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.001332 26718 log.cc:518] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: Log is configured to *not* fsync() on all Append() calls 03:46:59.017 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.017673 26713 tablet_bootstrap.cc:433] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: No bootstrap required, opened a new log 03:46:59.018 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.018347 26713 ts_tablet_manager.cc:823] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: Time spent bootstrapping tablet: real 0.061s user 0.000s sys 0.004s 03:46:59.020 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.020289 26713 raft_consensus.cc:287] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5523597a5ba64da387c3f0b472f8efd7" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "c804fbfdc126477889927ffc4b2c5373" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:59.020 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.020474 26715 tablet_bootstrap.cc:433] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: No bootstrap required, opened a new log 03:46:59.020 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.020625 26713 raft_consensus.cc:313] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:59.021 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.020969 26715 ts_tablet_manager.cc:823] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s 03:46:59.021 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.021139 26713 raft_consensus.cc:576] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c804fbfdc126477889927ffc4b2c5373, State: Initialized, Role: FOLLOWER 03:46:59.021 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.021446 26713 consensus_queue.cc:190] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:59.022 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.022716 26715 raft_consensus.cc:287] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5523597a5ba64da387c3f0b472f8efd7" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "c804fbfdc126477889927ffc4b2c5373" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:59.023 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.023015 26715 raft_consensus.cc:313] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:59.023 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.023496 26715 raft_consensus.cc:576] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5523597a5ba64da387c3f0b472f8efd7, State: Initialized, Role: FOLLOWER 03:46:59.023 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.023782 26715 consensus_queue.cc:190] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:59.024 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@71b1e8b7@1907484855 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545) -> (continuation of Deferred@754559933 after org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662) -> (continuation of Deferred@2074215033 after org.apache.kudu.client.AsyncKuduClient$12@181367cc@403924940) -> (continuation of Deferred@276038015 after org.apache.kudu.client.AsyncKuduClient$12@71b1e8b7@1907484855), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545) -> (continuation of Deferred@754559933 after org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662) -> (continuation of Deferred@2074215033 after org.apache.kudu.client.AsyncKuduClient$12@181367cc@403924940) -> (continuation of Deferred@276038015 after org.apache.kudu.client.AsyncKuduClient$12@71b1e8b7@1907484855)), so the following Deferred is getting paused: Deferred@276038015(state=PAUSED, result=Deferred@989501196, callback=, errback=) 03:46:59.051 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.049356 26718 tablet_bootstrap.cc:433] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: No bootstrap required, opened a new log 03:46:59.051 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.049625 26718 ts_tablet_manager.cc:823] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.000s 03:46:59.052 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.051194 26718 raft_consensus.cc:287] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5523597a5ba64da387c3f0b472f8efd7" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "c804fbfdc126477889927ffc4b2c5373" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:59.052 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.051260 26718 raft_consensus.cc:313] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 03:46:59.052 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.051452 26718 raft_consensus.cc:576] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d15f8d44784beaa17f6a2b9d44c68f, State: Initialized, Role: FOLLOWER 03:46:59.052 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.051550 26718 consensus_queue.cc:190] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 03:46:59.054 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.053973 26713 ts_tablet_manager.cc:851] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: Time spent starting tablet: real 0.035s user 0.000s sys 0.000s 03:46:59.066 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.065858 26640 heartbeater.cc:406] Master 127.70.237.1:64034 was elected leader, sending a full tablet report... 03:46:59.069 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.069645 26715 ts_tablet_manager.cc:851] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Time spent starting tablet: real 0.048s user 0.004s sys 0.000s 03:46:59.075 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.075893 26718 ts_tablet_manager.cc:851] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s 03:46:59.123 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.121091 26726 raft_consensus.cc:412] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 03:46:59.123 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.121198 26726 raft_consensus.cc:2456] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Snoozing failure detection for 1.772s (starting election) 03:46:59.123 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.121338 26726 raft_consensus.cc:434] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5523597a5ba64da387c3f0b472f8efd7" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "c804fbfdc126477889927ffc4b2c5373" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:59.123 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.122355 26726 leader_election.cc:221] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer c804fbfdc126477889927ffc4b2c5373 03:46:59.123 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.122659 26726 leader_election.cc:221] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer b5d15f8d44784beaa17f6a2b9d44c68f 03:46:59.144 [DEBUG - New I/O worker #459] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@13da29ba@333064634 returned Deferred@989501196(state=PENDING, result=null, callback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545) -> (continuation of Deferred@754559933 after org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662) -> (continuation of Deferred@2074215033 after org.apache.kudu.client.AsyncKuduClient$12@181367cc@403924940) -> (continuation of Deferred@276038015 after org.apache.kudu.client.AsyncKuduClient$12@71b1e8b7@1907484855) -> (continuation of Deferred@2021671026 after org.apache.kudu.client.AsyncKuduClient$12@13da29ba@333064634), errback=(continuation of Deferred@945146598 after org.apache.kudu.client.AsyncKuduClient$2@40b3917e@1085510014) -> (continuation of Deferred@1118049457 after org.apache.kudu.client.AsyncKuduClient$12@4ff097ec@1341167596) -> (continuation of Deferred@1892090757 after org.apache.kudu.client.AsyncKuduClient$12@1e6bb5b3@510375347) -> (continuation of Deferred@1503674307 after org.apache.kudu.client.AsyncKuduClient$12@3b43a586@994289030) -> (continuation of Deferred@1379282051 after org.apache.kudu.client.AsyncKuduClient$12@1a25cf69@438685545) -> (continuation of Deferred@754559933 after org.apache.kudu.client.AsyncKuduClient$12@747fdcd6@1954536662) -> (continuation of Deferred@2074215033 after org.apache.kudu.client.AsyncKuduClient$12@181367cc@403924940) -> (continuation of Deferred@276038015 after org.apache.kudu.client.AsyncKuduClient$12@71b1e8b7@1907484855) -> (continuation of Deferred@2021671026 after org.apache.kudu.client.AsyncKuduClient$12@13da29ba@333064634)), so the following Deferred is getting paused: Deferred@2021671026(state=PAUSED, result=Deferred@989501196, callback=, errback=) 03:46:59.152 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.151754 26027 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "b6b86156e9b74d87be85b30cdb0c6c38" candidate_uuid: "5523597a5ba64da387c3f0b472f8efd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c804fbfdc126477889927ffc4b2c5373" is_pre_election: true 03:46:59.152 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.151993 26027 raft_consensus.cc:2456] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: Snoozing failure detection for 1.833s (vote granted) 03:46:59.152 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.152051 26027 raft_consensus.cc:2010] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5523597a5ba64da387c3f0b472f8efd7 in term 0. 03:46:59.153 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.153102 26187 leader_election.cc:353] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 pre-election: Vote granted by peer c804fbfdc126477889927ffc4b2c5373 03:46:59.153 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.153163 26187 leader_election.cc:248] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 03:46:59.155 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.155416 26158 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "b6b86156e9b74d87be85b30cdb0c6c38" candidate_uuid: "5523597a5ba64da387c3f0b472f8efd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" is_pre_election: true 03:46:59.156 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.155601 26158 raft_consensus.cc:2456] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: Snoozing failure detection for 1.846s (vote granted) 03:46:59.156 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.155652 26158 raft_consensus.cc:2010] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5523597a5ba64da387c3f0b472f8efd7 in term 0. 03:46:59.156 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.155724 26148 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "b6b86156e9b74d87be85b30cdb0c6c38" candidate_uuid: "5523597a5ba64da387c3f0b472f8efd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" 03:46:59.156 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.155779 26148 raft_consensus.cc:2508] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f [term 0 FOLLOWER]: Advancing to term 1 03:46:59.156 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.155860 26148 raft_consensus.cc:2456] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f: Snoozing failure detection for 1.551s (vote granted) 03:46:59.156 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.156678 26148 raft_consensus.cc:2010] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5523597a5ba64da387c3f0b472f8efd7 in term 1. 03:46:59.156 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.153810 26726 raft_consensus.cc:2456] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Snoozing failure detection for 2.244s (election complete) 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.153857 26726 raft_consensus.cc:2280] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 0 FOLLOWER]: Leader pre-election won for term 1 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.153878 26726 raft_consensus.cc:412] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.153887 26726 raft_consensus.cc:2456] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Snoozing failure detection for 1.864s (starting election) 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.153899 26726 raft_consensus.cc:2508] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 0 FOLLOWER]: Advancing to term 1 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.154911 26726 raft_consensus.cc:434] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5523597a5ba64da387c3f0b472f8efd7" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "c804fbfdc126477889927ffc4b2c5373" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.155197 26726 leader_election.cc:221] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 election: Requesting vote from peer c804fbfdc126477889927ffc4b2c5373 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.155302 26726 leader_election.cc:221] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 election: Requesting vote from peer b5d15f8d44784beaa17f6a2b9d44c68f 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.156635 26180 leader_election.cc:353] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 pre-election: Vote granted by peer b5d15f8d44784beaa17f6a2b9d44c68f 03:46:59.157 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.157723 26180 leader_election.cc:353] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 election: Vote granted by peer b5d15f8d44784beaa17f6a2b9d44c68f 03:46:59.158 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.157752 26180 leader_election.cc:248] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 03:46:59.158 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.158183 26726 raft_consensus.cc:2456] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7: Snoozing failure detection for 1.818s (election complete) 03:46:59.158 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.158221 26726 raft_consensus.cc:2280] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 1 FOLLOWER]: Leader election won for term 1 03:46:59.159 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.158082 26027 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "b6b86156e9b74d87be85b30cdb0c6c38" candidate_uuid: "5523597a5ba64da387c3f0b472f8efd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c804fbfdc126477889927ffc4b2c5373" 03:46:59.159 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.158156 26027 raft_consensus.cc:2508] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373 [term 0 FOLLOWER]: Advancing to term 1 03:46:59.159 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.158257 26027 raft_consensus.cc:2456] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373: Snoozing failure detection for 1.974s (vote granted) 03:46:59.159 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.159063 26027 raft_consensus.cc:2010] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5523597a5ba64da387c3f0b472f8efd7 in term 1. 03:46:59.161 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.158681 26726 raft_consensus.cc:542] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [term 1 LEADER]: Becoming Leader. State: Replica: 5523597a5ba64da387c3f0b472f8efd7, State: Running, Role: LEADER 03:46:59.162 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.158908 26726 consensus_queue.cc:169] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5523597a5ba64da387c3f0b472f8efd7" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "c804fbfdc126477889927ffc4b2c5373" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } 03:46:59.162 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.159750 26187 leader_election.cc:353] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [CANDIDATE]: Term 1 election: Vote granted by peer c804fbfdc126477889927ffc4b2c5373 03:46:59.165 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0918 03:46:59.165673 25780 catalog_manager.cc:2511] T b6b86156e9b74d87be85b30cdb0c6c38 reported cstate change: term changed from 0 to 1, leader changed from to 5523597a5ba64da387c3f0b472f8efd7 (127.70.237.1). New cstate: current_term: 1 leader_uuid: "5523597a5ba64da387c3f0b472f8efd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5523597a5ba64da387c3f0b472f8efd7" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64040 } } peers { permanent_uuid: "c804fbfdc126477889927ffc4b2c5373" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64038 } } peers { permanent_uuid: "b5d15f8d44784beaa17f6a2b9d44c68f" member_type: VOTER last_known_addr { host: "127.70.237.1" port: 64036 } } } 03:46:59.365 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7d244854, flushNotification=Deferred@2031866664(state=PENDING, result=null, callback=, errback=)} 03:46:59.365 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@3c19426f@1008288367 returned Deferred@1381371084(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@233805882 after org.apache.kudu.client.AsyncKuduSession$1@3c19426f@1008288367), errback=passthrough -> (continuation of Deferred@233805882 after org.apache.kudu.client.AsyncKuduSession$1@3c19426f@1008288367)), so the following Deferred is getting paused: Deferred@233805882(state=PAUSED, result=Deferred@1381371084, callback=, errback=) 03:46:59.367 [DEBUG - New I/O worker #459] (AsyncKuduClient.java:1727) Learned about tablet b6b86156e9b74d87be85b30cdb0c6c38 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:46:59.367 [DEBUG - New I/O worker #459] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=b6b86156e9b74d87be85b30cdb0c6c38, ttl=299999}] 03:46:59.408 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0918 03:46:59.408532 26027 raft_consensus.cc:964] T b6b86156e9b74d87be85b30cdb0c6c38 P c804fbfdc126477889927ffc4b2c5373 [term 1 FOLLOWER]: Refusing update from remote peer 5523597a5ba64da387c3f0b472f8efd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:59.408 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0918 03:46:59.408532 26148 raft_consensus.cc:964] T b6b86156e9b74d87be85b30cdb0c6c38 P b5d15f8d44784beaa17f6a2b9d44c68f [term 1 FOLLOWER]: Refusing update from remote peer 5523597a5ba64da387c3f0b472f8efd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 03:46:59.409 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.409493 26737 consensus_queue.cc:741] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [LEADER]: Connected to new peer: Peer: b5d15f8d44784beaa17f6a2b9d44c68f, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:59.412 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0918 03:46:59.411950 26726 consensus_queue.cc:741] T b6b86156e9b74d87be85b30cdb0c6c38 P 5523597a5ba64da387c3f0b472f8efd7 [LEADER]: Connected to new peer: Peer: c804fbfdc126477889927ffc4b2c5373, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 03:46:59.459 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 1 rows, more=false) 03:46:59.580 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:59.583 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:59.586 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:59.589 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:59.589 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=null, flushNotification=Deferred@709527612(state=PENDING, result=null, callback=, errback=)} 03:46:59.590 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@5c36bd20@1547091232 returned Deferred@1046800902(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@2031866664 after org.apache.kudu.client.AsyncKuduSession$1@5c36bd20@1547091232), errback=passthrough -> (continuation of Deferred@2031866664 after org.apache.kudu.client.AsyncKuduSession$1@5c36bd20@1547091232)), so the following Deferred is getting paused: Deferred@2031866664(state=PAUSED, result=Deferred@1046800902, callback=, errback=) 03:46:59.607 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:46:59.661 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 03:46:59.661 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4f3b8bb8, flushNotification=Deferred@827253003(state=PENDING, result=null, callback=, errback=)} 03:46:59.679 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:47:00.682 [DEBUG - Hashed wheel timer #8] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6cae8460, flushNotification=Deferred@1651079045(state=PENDING, result=null, callback=, errback=)} 03:47:00.757 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 11 rows, more=false) 03:47:00.778 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 31 rows, more=false) 03:47:00.794 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 03:47:00.797 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 03:47:00.798 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@1484293567(state=PENDING, result=null, callback=, errback=)} 03:47:00.799 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@4155706c@1096118380 returned Deferred@1386235317(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1651079045 after org.apache.kudu.client.AsyncKuduSession$1@4155706c@1096118380), errback=passthrough -> (continuation of Deferred@1651079045 after org.apache.kudu.client.AsyncKuduSession$1@4155706c@1096118380)), so the following Deferred is getting paused: Deferred@1651079045(state=PAUSED, result=Deferred@1386235317, callback=, errback=) 03:47:00.815 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:47:00.819 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:47:00.820 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@346075219(state=PENDING, result=null, callback=, errback=)} 03:47:00.822 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@8e99a05@149527045 returned Deferred@1649761636(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1484293567 after org.apache.kudu.client.AsyncKuduSession$1@8e99a05@149527045), errback=passthrough -> (continuation of Deferred@1484293567 after org.apache.kudu.client.AsyncKuduSession$1@8e99a05@149527045)), so the following Deferred is getting paused: Deferred@1484293567(state=PAUSED, result=Deferred@1649761636, callback=, errback=) 03:47:00.844 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:47:00.916 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:47:00.917 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@32883176, flushNotification=Deferred@599473500(state=PENDING, result=null, callback=, errback=)} 03:47:00.918 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@67c6b29c, flushNotification=Deferred@800095613(state=PENDING, result=null, callback=, errback=)} 03:47:00.923 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5cc0ea7c, flushNotification=Deferred@644578661(state=PENDING, result=null, callback=, errback=)} 03:47:00.925 [DEBUG - New I/O worker #460] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@1417d177@337105271 returned Deferred@271075117(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@800095613 after org.apache.kudu.client.AsyncKuduSession$1@1417d177@337105271), errback=passthrough -> (continuation of Deferred@800095613 after org.apache.kudu.client.AsyncKuduSession$1@1417d177@337105271)), so the following Deferred is getting paused: Deferred@800095613(state=PAUSED, result=Deferred@271075117, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 03:47:00.933 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 21 rows, more=false) 03:47:00.934 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@746b7966, flushNotification=Deferred@1478277379(state=PENDING, result=null, callback=, errback=)} 03:47:00.934 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3542b76, flushNotification=Deferred@2125065772(state=PENDING, result=null, callback=, errback=)} 03:47:00.938 [DEBUG - New I/O worker #460] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@552adb4c@1428872012 returned Deferred@1308866416(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1478277379 after org.apache.kudu.client.AsyncKuduSession$1@552adb4c@1428872012), errback=passthrough -> (continuation of Deferred@1478277379 after org.apache.kudu.client.AsyncKuduSession$1@552adb4c@1428872012)), so the following Deferred is getting paused: Deferred@1478277379(state=PAUSED, result=Deferred@1308866416, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 03:47:00.943 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:47:01.005 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:47:01.014 [DEBUG - New I/O worker #459] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:47:01.014 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1361451222(state=PENDING, result=null, callback=, errback=)} 03:47:01.015 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6c4f7750, flushNotification=Deferred@1315106356(state=PENDING, result=null, callback=, errback=)} 03:47:01.032 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7f0bb15a, flushNotification=Deferred@504030917(state=PENDING, result=null, callback=, errback=)} 03:47:01.035 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@9e8e7a3, flushNotification=Deferred@1352842212(state=PENDING, result=null, callback=, errback=)} 03:47:01.074 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1921077707(state=PENDING, result=null, callback=, errback=)} 03:47:01.074 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3bf4bd90, flushNotification=Deferred@1970241714(state=PENDING, result=null, callback=, errback=)} 03:47:01.085 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@30577860, flushNotification=Deferred@1218472104(state=PENDING, result=null, callback=, errback=)} 03:47:01.086 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@56a64411, flushNotification=Deferred@1598370919(state=PENDING, result=null, callback=, errback=)} 03:47:01.090 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@54dac397, flushNotification=Deferred@527701132(state=PENDING, result=null, callback=, errback=)} 03:47:01.093 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7b964dbf, flushNotification=Deferred@226932902(state=PENDING, result=null, callback=, errback=)} 03:47:01.098 [DEBUG - New I/O worker #460] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@64b54bae@1689602990 returned Deferred@913733946(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@527701132 after org.apache.kudu.client.AsyncKuduSession$1@64b54bae@1689602990), errback=passthrough -> (continuation of Deferred@527701132 after org.apache.kudu.client.AsyncKuduSession$1@64b54bae@1689602990)), so the following Deferred is getting paused: Deferred@527701132(state=PAUSED, result=Deferred@913733946, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 03:47:01.103 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 03:47:01.104 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@816685546(state=PENDING, result=null, callback=, errback=)} 03:47:01.105 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@791fe9f5, flushNotification=Deferred@1097084408(state=PENDING, result=null, callback=, errback=)} 03:47:01.125 [DEBUG - New I/O worker #461] (AsyncKuduClient.java:1727) Learned about tablet b6b86156e9b74d87be85b30cdb0c6c38 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:47:01.125 [DEBUG - New I/O worker #461] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=b6b86156e9b74d87be85b30cdb0c6c38, ttl=299999}] 03:47:01.126 [DEBUG - New I/O worker #461] (AsyncKuduClient.java:1727) Learned about tablet b6b86156e9b74d87be85b30cdb0c6c38 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:47:01.126 [DEBUG - New I/O worker #461] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=b6b86156e9b74d87be85b30cdb0c6c38, ttl=299999}] 03:47:01.127 [DEBUG - New I/O worker #461] (AsyncKuduClient.java:1727) Learned about tablet b6b86156e9b74d87be85b30cdb0c6c38 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505706385081' with partition [, ) 03:47:01.127 [DEBUG - New I/O worker #461] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=b6b86156e9b74d87be85b30cdb0c6c38, ttl=299999}] 03:47:01.131 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5e1e94fa, flushNotification=Deferred@65129506(state=PENDING, result=null, callback=, errback=)} 03:47:01.137 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@537ddea, flushNotification=Deferred@1700539225(state=PENDING, result=null, callback=, errback=)} 03:47:01.139 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4f4fca4c, flushNotification=Deferred@1120051035(state=PENDING, result=null, callback=, errback=)} 03:47:01.142 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7921c264, flushNotification=Deferred@2099456250(state=PENDING, result=null, callback=, errback=)} 03:47:01.144 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4c0f90b8, flushNotification=Deferred@442623525(state=PENDING, result=null, callback=, errback=)} 03:47:01.147 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6d2435ef, flushNotification=Deferred@153396297(state=PENDING, result=null, callback=, errback=)} 03:47:01.149 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@399e7f85, flushNotification=Deferred@752608861(state=PENDING, result=null, callback=, errback=)} 03:47:01.152 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@601c2564, flushNotification=Deferred@1278657474(state=PENDING, result=null, callback=, errback=)} 03:47:01.160 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@69eff96, flushNotification=Deferred@1971587094(state=PENDING, result=null, callback=, errback=)} 03:47:01.160 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@743234c7, flushNotification=Deferred@249614672(state=PENDING, result=null, callback=, errback=)} 03:47:01.166 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7ff3fd55, flushNotification=Deferred@711101957(state=PENDING, result=null, callback=, errback=)} 03:47:01.170 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4f931382, flushNotification=Deferred@1206985073(state=PENDING, result=null, callback=, errback=)} 03:47:01.172 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2708658f, flushNotification=Deferred@421840333(state=PENDING, result=null, callback=, errback=)} 03:47:01.175 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4efcda68, flushNotification=Deferred@13140079(state=PENDING, result=null, callback=, errback=)} 03:47:01.185 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1678289380(state=PENDING, result=null, callback=, errback=)} 03:47:01.187 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5bbd0205, flushNotification=Deferred@1933225088(state=PENDING, result=null, callback=, errback=)} 03:47:01.192 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@37359170, flushNotification=Deferred@374557179(state=PENDING, result=null, callback=, errback=)} 03:47:01.201 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@25cddc1e, flushNotification=Deferred@53820043(state=PENDING, result=null, callback=, errback=)} 03:47:01.212 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1890958c, flushNotification=Deferred@343940084(state=PENDING, result=null, callback=, errback=)} 03:47:01.224 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5f661856, flushNotification=Deferred@1965916243(state=PENDING, result=null, callback=, errback=)} 03:47:01.237 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@698d478f, flushNotification=Deferred@2110177009(state=PENDING, result=null, callback=, errback=)} 03:47:01.250 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@128dadb7, flushNotification=Deferred@196843693(state=PENDING, result=null, callback=, errback=)} 03:47:01.269 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@143202154(state=PENDING, result=null, callback=, errback=)} 03:47:01.281 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=30), No traces, null) with no deferred attached! 03:47:01.282 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1081082300(state=PENDING, result=null, callback=, errback=)} 03:47:01.291 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=8), No traces, null) with no deferred attached! 03:47:01.296 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1072692240(state=PENDING, result=null, callback=, errback=)} 03:47:01.309 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=13), No traces, null) with no deferred attached! 03:47:01.311 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1749448112(state=PENDING, result=null, callback=, errback=)} 03:47:01.322 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:47:01.324 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@682892693(state=PENDING, result=null, callback=, errback=)} 03:47:01.334 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:47:01.338 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1745454302(state=PENDING, result=null, callback=, errback=)} 03:47:01.347 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:47:01.350 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@675736243(state=PENDING, result=null, callback=, errback=)} 03:47:01.361 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=11), No traces, null) with no deferred attached! 03:47:01.362 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1937170942(state=PENDING, result=null, callback=, errback=)} 03:47:01.375 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=13), No traces, null) with no deferred attached! 03:47:01.377 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2074477232(state=PENDING, result=null, callback=, errback=)} 03:47:01.382 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5f2d466e, flushNotification=Deferred@1084304458(state=PENDING, result=null, callback=, errback=)} 03:47:01.396 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@41c5cb1, flushNotification=Deferred@1331981568(state=PENDING, result=null, callback=, errback=)} 03:47:01.409 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7a4f5cb4, flushNotification=Deferred@860224715(state=PENDING, result=null, callback=, errback=)} 03:47:01.422 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@555ad7c6, flushNotification=Deferred@968535040(state=PENDING, result=null, callback=, errback=)} 03:47:01.434 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3990fd7f, flushNotification=Deferred@623897890(state=PENDING, result=null, callback=, errback=)} 03:47:01.454 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@650705574(state=PENDING, result=null, callback=, errback=)} 03:47:01.467 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=32), No traces, null) with no deferred attached! 03:47:01.467 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1258199251(state=PENDING, result=null, callback=, errback=)} 03:47:01.478 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:47:01.479 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1958473718(state=PENDING, result=null, callback=, errback=)} 03:47:01.491 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=12), No traces, null) with no deferred attached! 03:47:01.491 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@774331070(state=PENDING, result=null, callback=, errback=)} 03:47:01.504 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=12), No traces, null) with no deferred attached! 03:47:01.510 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1339791382(state=PENDING, result=null, callback=, errback=)} 03:47:01.515 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@715da93e, flushNotification=Deferred@1513237692(state=PENDING, result=null, callback=, errback=)} 03:47:01.532 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4e547fee, flushNotification=Deferred@1574720794(state=PENDING, result=null, callback=, errback=)} 03:47:01.552 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1104417734(state=PENDING, result=null, callback=, errback=)} 03:47:01.568 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=36), No traces, null) with no deferred attached! 03:47:01.569 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@172523660(state=PENDING, result=null, callback=, errback=)} 03:47:01.573 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@678e3524, flushNotification=Deferred@1480972362(state=PENDING, result=null, callback=, errback=)} 03:47:01.596 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@971946663(state=PENDING, result=null, callback=, errback=)} 03:47:01.608 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=35), No traces, null) with no deferred attached! 03:47:01.610 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@2003567094(state=PENDING, result=null, callback=, errback=)} 03:47:01.628 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=18), No traces, null) with no deferred attached! 03:47:01.637 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 50 rows, more=false) 03:47:01.638 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@61dd3d2a, flushNotification=Deferred@388771539(state=PENDING, result=null, callback=, errback=)} 03:47:01.656 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=18), No traces, null) with no deferred attached! 03:47:01.659 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5bdb8513, flushNotification=Deferred@1286560815(state=PENDING, result=null, callback=, errback=)} 03:47:01.670 [DEBUG - New I/O worker #460] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=10), No traces, null) with no deferred attached! 03:47:01.679 [DEBUG - New I/O worker #460] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 03:47:01.691 [DEBUG - main] (Deferred.java:1330) callback=disconnect callback@230643635 returned Deferred@944427387(state=PENDING, result=null, callback=release resources callback -> (continuation of Deferred@1636182655 after disconnect callback@230643635), errback=passthrough -> (continuation of Deferred@1636182655 after disconnect callback@230643635)), so the following Deferred is getting paused: Deferred@1636182655(state=PAUSED, result=Deferred@944427387, callback=, errback=) 03:47:01.692 [DEBUG - New I/O worker #461] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:47:01.693 [DEBUG - New I/O worker #456] (Connection.java:666) [peer master-127.70.237.1:64030] cleaning up while in state READY due to: connection disconnected 03:47:01.694 [DEBUG - New I/O worker #457] (Connection.java:666) [peer master-127.70.237.1:64032] cleaning up while in state READY due to: connection disconnected 03:47:01.694 [DEBUG - New I/O worker #458] (Connection.java:666) [peer master-127.70.237.1:64034] cleaning up while in state READY due to: connection disconnected 03:47:01.695 [DEBUG - New I/O worker #460] (AsyncKuduClient.java:1872) Releasing all remaining resources 03:47:01.696 [DEBUG - New I/O worker #460] (Connection.java:666) [peer 5523597a5ba64da387c3f0b472f8efd7] cleaning up while in state READY due to: connection disconnected 03:47:01.769 [DEBUG - New I/O worker #392] (Connection.java:666) [peer master-127.70.237.1:64032] cleaning up while in state READY due to: connection disconnected 03:47:01.794 [DEBUG - New I/O worker #393] (Connection.java:666) [peer master-127.70.237.1:64034] cleaning up while in state READY due to: connection disconnected 03:47:01.795 [DEBUG - New I/O worker #394] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 03:47:01.857 [DEBUG - New I/O worker #391] (Connection.java:666) [peer master-127.70.237.1:64030] cleaning up while in state READY due to: connection disconnected