18:16:25.593 [INFO - main] (BaseKuduTest.java:75) Setting up before class... 18:16:25.643 [INFO - main] (MiniKuduCluster.java:152) Starting 3 masters... 18:16:26.073 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:26.074 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.073243 5492 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:26.074 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.074406 5492 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 18:16:26.074 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.074419 5492 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:26.075 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.074424 5492 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 18:16:26.075 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.074434 5492 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:26.076 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.075767 5492 master_main.cc:66] Master server non-default flags: 18:16:26.076 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:26.076 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 18:16:26.076 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931385710/data 18:16:26.076 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931385710/data 18:16:26.077 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 18:16:26.079 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --master_addresses=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:26.080 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:26.087 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 18:16:26.087 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64030 18:16:26.088 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:26.088 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_port=64031 18:16:26.088 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --never_fsync=true 18:16:26.089 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.5492 18:16:26.089 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:26.090 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:26.091 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:26.091 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:26.091 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931385710/logs 18:16:26.091 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --logtostderr=true 18:16:26.093 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Master server version: 18:16:26.093 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:26.093 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:26.094 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build type RELEASE 18:16:26.094 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:26.094 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build id 10042 18:16:26.094 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.076081 5492 minidump.cc:237] Setting minidump size limit to 20M 18:16:26.106 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.106153 5492 master_main.cc:73] Initializing master server... 18:16:26.106 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.106420 5492 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 684639 18:16:26.106 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.106591 5492 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931385710/data/instance: No such file or directory (error 2) 18:16:26.107 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.106604 5492 server_base.cc:229] Creating new FS layout 18:16:26.108 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.108824 5492 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931385710/data/instance: 18:16:26.109 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "cc55785a26934cc4ab3029ccde44c4dd" 18:16:26.109 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:26 on jenkins-slave-c3oe" 18:16:26.144 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.144611 5492 fs_manager.cc:434] Time spent creating directory manager: real 0.036s user 0.004s sys 0.000s 18:16:26.147 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.144933 5492 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:26.148 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.144979 5492 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:26.148 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.148665 5492 fs_manager.cc:336] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s 18:16:26.149 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.148730 5492 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931385710/data 18:16:26.149 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "cc55785a26934cc4ab3029ccde44c4dd" 18:16:26.149 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:26 on jenkins-slave-c3oe" 18:16:26.149 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.148767 5492 fs_report.cc:347] Block manager report 18:16:26.149 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) -------------------- 18:16:26.150 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931385710/data/data 18:16:26.150 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:26.150 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:26.152 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:26.152 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:26.152 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:26.152 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:26.153 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:26.153 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:26.154 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:26.154 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:26.232 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.232730 5492 master_main.cc:76] Starting Master server... 18:16:26.248 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.248586 5532 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:26.262 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.248627 5532 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:26.263 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.248636 5532 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:26.402 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:26.402 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:26.401916 5546 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:26.403 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:26.403192 5546 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 18:16:26.403 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:26.403214 5546 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:26.403 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:26.403220 5546 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 18:16:26.404 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:26.403230 5546 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:26.404 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.404605 5546 master_main.cc:66] Master server non-default flags: 18:16:26.405 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:26.405 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 18:16:26.405 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931385710/data 18:16:26.405 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931385710/data 18:16:26.405 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 18:16:26.406 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --master_addresses=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:26.407 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:26.407 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 18:16:26.407 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64032 18:16:26.407 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:26.408 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_port=64033 18:16:26.408 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --never_fsync=true 18:16:26.408 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.5546 18:16:26.409 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:26.409 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:26.410 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:26.410 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:26.411 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931385710/logs 18:16:26.411 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --logtostderr=true 18:16:26.411 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Master server version: 18:16:26.411 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:26.412 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:26.412 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build type RELEASE 18:16:26.420 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:26.423 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build id 10042 18:16:26.423 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.404934 5546 minidump.cc:237] Setting minidump size limit to 20M 18:16:26.468 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.468533 5546 master_main.cc:73] Initializing master server... 18:16:26.469 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.468847 5546 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 684639 18:16:26.469 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.469036 5546 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931385710/data/instance: No such file or directory (error 2) 18:16:26.475 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.469049 5546 server_base.cc:229] Creating new FS layout 18:16:26.475 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.471273 5546 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931385710/data/instance: 18:16:26.475 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "dbdab2d9d892423785874d17f429d296" 18:16:26.475 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:26 on jenkins-slave-c3oe" 18:16:26.484 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.484805 5546 fs_manager.cc:434] Time spent creating directory manager: real 0.013s user 0.000s sys 0.008s 18:16:26.485 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.485080 5546 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:26.485 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.485114 5546 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:26.512 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.512687 5546 fs_manager.cc:336] Time spent opening block manager: real 0.026s user 0.000s sys 0.008s 18:16:26.513 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.512766 5546 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931385710/data 18:16:26.513 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "dbdab2d9d892423785874d17f429d296" 18:16:26.513 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:26 on jenkins-slave-c3oe" 18:16:26.513 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.512809 5546 fs_report.cc:347] Block manager report 18:16:26.514 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) -------------------- 18:16:26.514 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931385710/data/data 18:16:26.514 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:26.514 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:26.514 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:26.515 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:26.515 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:26.515 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:26.515 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:26.516 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:26.516 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:26.516 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:26.628 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.628705 5492 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64030 18:16:26.629 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.628808 5492 webserver.cc:149] Starting webserver on 127.20.121.1:64031 18:16:26.629 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.628816 5492 webserver.cc:160] Document root disabled 18:16:26.629 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.629019 5492 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64031/ 18:16:26.645 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.645226 5602 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.656 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.656653 5546 master_main.cc:76] Starting Master server... 18:16:26.661 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.661509 5602 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.668 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.668754 5602 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64032: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64032: connect: Connection refused (error 111) 18:16:26.672 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.672523 5610 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:26.672 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.672902 5610 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:26.673 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.673118 5610 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:26.734 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.734395 5602 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } attempt: 1 18:16:26.735 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.735723 5602 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64032: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64032: connect: Connection refused (error 111) 18:16:26.782 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.782148 5602 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } attempt: 2 18:16:26.783 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.783746 5602 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64032: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64032: connect: Connection refused (error 111) 18:16:26.787 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:26.787 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:26.786897 5619 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:26.788 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:26.788622 5619 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 18:16:26.788 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:26.788954 5619 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:26.789 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:26.789211 5619 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 18:16:26.789 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:26.789485 5619 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:26.791 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.791126 5619 master_main.cc:66] Master server non-default flags: 18:16:26.791 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:26.791 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 18:16:26.791 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931385710/data 18:16:26.791 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931385710/data 18:16:26.791 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 18:16:26.792 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --master_addresses=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:26.792 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:26.792 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 18:16:26.792 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64034 18:16:26.792 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:26.792 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_port=64035 18:16:26.792 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --never_fsync=true 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.5619 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931385710/logs 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --logtostderr=true 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Master server version: 18:16:26.793 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:26.794 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:26.794 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build type RELEASE 18:16:26.794 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:26.794 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build id 10042 18:16:26.795 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.795169 5619 minidump.cc:237] Setting minidump size limit to 20M 18:16:26.826 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.826308 5546 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64032 18:16:26.826 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.826402 5546 webserver.cc:149] Starting webserver on 127.20.121.1:64033 18:16:26.827 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.826412 5546 webserver.cc:160] Document root disabled 18:16:26.827 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.826617 5546 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64033/ 18:16:26.830 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.830837 5689 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.840 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.838028 5619 master_main.cc:73] Initializing master server... 18:16:26.840 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.838338 5619 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 684639 18:16:26.841 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.838521 5619 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931385710/data/instance: No such file or directory (error 2) 18:16:26.841 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.838534 5619 server_base.cc:229] Creating new FS layout 18:16:26.841 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.841662 5689 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.850 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.850178 5602 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } attempt: 3 18:16:26.854 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.852707 5619 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931385710/data/instance: 18:16:26.854 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "fc18203a324d4a5186ae7e258d85e029" 18:16:26.854 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:26 on jenkins-slave-c3oe" 18:16:26.856 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.855330 5619 fs_manager.cc:434] Time spent creating directory manager: real 0.002s user 0.000s sys 0.000s 18:16:26.856 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.855530 5619 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:26.857 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.855563 5619 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:26.873 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.873107 5602 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.873 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.873107 5689 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.874 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.874112 5602 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64034: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64034: connect: Connection refused (error 111) 18:16:26.876 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.876708 5619 fs_manager.cc:336] Time spent opening block manager: real 0.020s user 0.000s sys 0.000s 18:16:26.877 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.877143 5619 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931385710/data 18:16:26.877 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "fc18203a324d4a5186ae7e258d85e029" 18:16:26.877 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:26 on jenkins-slave-c3oe" 18:16:26.877 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.877686 5619 fs_report.cc:347] Block manager report 18:16:26.877 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) -------------------- 18:16:26.877 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931385710/data/data 18:16:26.878 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:26.878 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:26.878 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:26.878 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:26.878 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:26.878 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:26.878 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:26.878 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:26.879 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:26.879 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:26.884 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:26.884730 5689 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64034: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64034: connect: Connection refused (error 111) 18:16:26.923 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.923470 5602 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } attempt: 1 18:16:26.923 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:26.923812 5602 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64034: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64034: connect: Connection refused (error 111) 18:16:26.931 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.930922 5619 master_main.cc:76] Starting Master server... 18:16:26.931 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.931062 5718 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:26.931 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.931080 5718 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:26.931 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.931085 5718 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:26.936 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.936652 5619 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64034 18:16:26.936 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.936746 5619 webserver.cc:149] Starting webserver on 127.20.121.1:64035 18:16:26.937 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.936755 5619 webserver.cc:160] Document root disabled 18:16:26.937 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.936969 5619 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64035/ 18:16:26.939 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.939216 5763 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.949 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.949790 5763 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.950 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.949908 5689 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } attempt: 1 18:16:26.952 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.952450 5763 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 18:16:26.956 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.955935 5602 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } attempt: 2 18:16:26.974 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.973955 5689 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296: Bootstrap starting. 18:16:26.975 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.974478 5689 tablet_bootstrap.cc:567] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296: No blocks or log segments found. Creating new log. 18:16:26.975 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.974719 5689 log.cc:519] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296: Log is configured to *not* fsync() on all Append() calls 18:16:26.975 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.975386 5763 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029: Bootstrap starting. 18:16:26.975 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.975801 5763 tablet_bootstrap.cc:567] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029: No blocks or log segments found. Creating new log. 18:16:26.976 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.976043 5763 log.cc:519] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029: Log is configured to *not* fsync() on all Append() calls 18:16:26.976 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.976541 5602 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Bootstrap starting. 18:16:26.977 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.977188 5602 tablet_bootstrap.cc:567] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: No blocks or log segments found. Creating new log. 18:16:26.977 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.977653 5602 log.cc:519] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Log is configured to *not* fsync() on all Append() calls 18:16:26.984 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.984886 5602 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: No bootstrap required, opened a new log 18:16:26.985 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.985302 5602 raft_consensus.cc:286] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:26.985 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.985333 5602 raft_consensus.cc:312] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:26.985 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.985419 5602 raft_consensus.cc:575] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc55785a26934cc4ab3029ccde44c4dd, State: Initialized, Role: FOLLOWER 18:16:26.985 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:26.985451 5602 consensus_queue.cc:190] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:26.988 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.988196 5763 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029: No bootstrap required, opened a new log 18:16:26.988 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.988834 5689 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296: No bootstrap required, opened a new log 18:16:26.988 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.988891 5763 raft_consensus.cc:286] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:26.989 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.989069 5763 raft_consensus.cc:312] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:26.989 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.989138 5763 raft_consensus.cc:575] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc18203a324d4a5186ae7e258d85e029, State: Initialized, Role: FOLLOWER 18:16:26.989 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.989171 5763 consensus_queue.cc:190] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:26.989 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.989101 5689 raft_consensus.cc:286] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:26.989 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.989128 5689 raft_consensus.cc:312] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:26.990 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.989226 5689 raft_consensus.cc:575] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbdab2d9d892423785874d17f429d296, State: Initialized, Role: FOLLOWER 18:16:26.990 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:26.989253 5689 consensus_queue.cc:190] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:26.996 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.996700 5763 sys_catalog.cc:321] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:26.997 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.996714 5773 sys_catalog.cc:321] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:26.997 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.996754 5763 sys_catalog.cc:324] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: This master's current role is: FOLLOWER 18:16:26.997 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.996758 5773 sys_catalog.cc:324] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: This master's current role is: FOLLOWER 18:16:26.997 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:26.996898 5763 sys_catalog.cc:408] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: configured and running, proceeding with master startup. 18:16:27.004 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.004685 5689 sys_catalog.cc:321] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.005 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.004737 5689 sys_catalog.cc:324] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: This master's current role is: FOLLOWER 18:16:27.005 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.004884 5689 sys_catalog.cc:408] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: configured and running, proceeding with master startup. 18:16:27.005 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.005067 5602 sys_catalog.cc:321] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.005 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.005254 5602 sys_catalog.cc:324] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [sys.catalog]: This master's current role is: FOLLOWER 18:16:27.005 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.005403 5602 sys_catalog.cc:408] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [sys.catalog]: configured and running, proceeding with master startup. 18:16:27.005 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.005780 5771 sys_catalog.cc:321] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.006 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.005795 5771 sys_catalog.cc:324] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [sys.catalog]: This master's current role is: FOLLOWER 18:16:27.005 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.005743 5774 sys_catalog.cc:321] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.006 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.005947 5774 sys_catalog.cc:324] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: This master's current role is: FOLLOWER 18:16:27.008 [INFO - main] (MiniKuduCluster.java:155) Starting 3 tablet servers... 18:16:27.012 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.012650 5619 master_main.cc:79] Master server successfully started. 18:16:27.012 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.012675 5777 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 18:16:27.013 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.012768 5546 master_main.cc:79] Master server successfully started. 18:16:27.013 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.013106 5492 master_main.cc:79] Master server successfully started. 18:16:27.014 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.013042 5778 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 18:16:27.030 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.030738 5771 raft_consensus.cc:411] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 18:16:27.031 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.030805 5771 raft_consensus.cc:2455] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Snoozing failure detection for 0.659s (starting election) 18:16:27.031 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.030901 5771 raft_consensus.cc:433] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:27.031 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.031103 5771 leader_election.cc:221] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer dbdab2d9d892423785874d17f429d296 18:16:27.031 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.031178 5771 leader_election.cc:221] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer fc18203a324d4a5186ae7e258d85e029 18:16:27.032 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.032505 5659 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc55785a26934cc4ab3029ccde44c4dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbdab2d9d892423785874d17f429d296" is_pre_election: true 18:16:27.032 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.032577 5659 raft_consensus.cc:2455] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296: Snoozing failure detection for 0.788s (vote granted) 18:16:27.032 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.032600 5659 raft_consensus.cc:2009] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc55785a26934cc4ab3029ccde44c4dd in term 0. 18:16:27.033 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.033810 5523 leader_election.cc:353] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 pre-election: Vote granted by peer fc18203a324d4a5186ae7e258d85e029 18:16:27.034 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.033839 5523 leader_election.cc:248] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 18:16:27.034 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.033965 5525 leader_election.cc:353] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 pre-election: Vote granted by peer dbdab2d9d892423785874d17f429d296 18:16:27.034 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.034032 5771 raft_consensus.cc:2455] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Snoozing failure detection for 0.661s (election complete) 18:16:27.034 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.034049 5771 raft_consensus.cc:2279] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 0 FOLLOWER]: Leader pre-election won for term 1 18:16:27.034 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.034060 5771 raft_consensus.cc:411] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 18:16:27.034 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.034067 5771 raft_consensus.cc:2455] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Snoozing failure detection for 0.849s (starting election) 18:16:27.034 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.034073 5771 raft_consensus.cc:2507] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 0 FOLLOWER]: Advancing to term 1 18:16:27.035 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.034849 5771 raft_consensus.cc:433] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:27.035 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.034984 5771 leader_election.cc:221] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 election: Requesting vote from peer dbdab2d9d892423785874d17f429d296 18:16:27.035 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.035018 5771 leader_election.cc:221] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 election: Requesting vote from peer fc18203a324d4a5186ae7e258d85e029 18:16:27.036 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.036041 5523 leader_election.cc:353] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 election: Vote granted by peer fc18203a324d4a5186ae7e258d85e029 18:16:27.036 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.036064 5523 leader_election.cc:248] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 18:16:27.037 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.036965 5525 leader_election.cc:353] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [CANDIDATE]: Term 1 election: Vote granted by peer dbdab2d9d892423785874d17f429d296 18:16:27.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.033529 5740 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc55785a26934cc4ab3029ccde44c4dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc18203a324d4a5186ae7e258d85e029" is_pre_election: true 18:16:27.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.033591 5740 raft_consensus.cc:2455] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029: Snoozing failure detection for 0.810s (vote granted) 18:16:27.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.033610 5740 raft_consensus.cc:2009] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc55785a26934cc4ab3029ccde44c4dd in term 0. 18:16:27.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.035275 5740 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc55785a26934cc4ab3029ccde44c4dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc18203a324d4a5186ae7e258d85e029" 18:16:27.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.035298 5740 raft_consensus.cc:2507] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [term 0 FOLLOWER]: Advancing to term 1 18:16:27.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.035327 5740 raft_consensus.cc:2455] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029: Snoozing failure detection for 0.776s (vote granted) 18:16:27.038 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.035934 5740 raft_consensus.cc:2009] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc55785a26934cc4ab3029ccde44c4dd in term 1. 18:16:27.038 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.036164 5659 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc55785a26934cc4ab3029ccde44c4dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbdab2d9d892423785874d17f429d296" 18:16:27.038 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.036197 5659 raft_consensus.cc:2507] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [term 0 FOLLOWER]: Advancing to term 1 18:16:27.038 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.036229 5659 raft_consensus.cc:2455] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296: Snoozing failure detection for 0.640s (vote granted) 18:16:27.038 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.036854 5659 raft_consensus.cc:2009] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc55785a26934cc4ab3029ccde44c4dd in term 1. 18:16:27.037 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.037029 5771 raft_consensus.cc:2455] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Snoozing failure detection for 0.739s (election complete) 18:16:27.038 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.037042 5771 raft_consensus.cc:2279] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 1 FOLLOWER]: Leader election won for term 1 18:16:27.056 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:27.057 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:27.056507 5779 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:27.057 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:27.057540 5779 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:27.057 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:27.057566 5779 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:27.057 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:27.057575 5779 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:27.059 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.058858 5779 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:27.059 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:27.059 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:27.059 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:27.059 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:27.059 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64036 18:16:27.060 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:27.060 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 18:16:27.060 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:27.060 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:27.061 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 18:16:27.061 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.5779 18:16:27.062 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:27.062 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:27.062 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:27.062 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:27.062 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/logs 18:16:27.062 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 18:16:27.063 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 18:16:27.063 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:27.058 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.056536 5771 raft_consensus.cc:541] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [term 1 LEADER]: Becoming Leader. State: Replica: cc55785a26934cc4ab3029ccde44c4dd, State: Running, Role: LEADER 18:16:27.063 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.056689 5771 consensus_queue.cc:169] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:27.063 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.059300 5771 sys_catalog.cc:321] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc55785a26934cc4ab3029ccde44c4dd. Latest consensus state: current_term: 1 leader_uuid: "cc55785a26934cc4ab3029ccde44c4dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.063 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.059316 5771 sys_catalog.cc:324] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [sys.catalog]: This master's current role is: LEADER 18:16:27.063 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:27.064 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type RELEASE 18:16:27.064 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:27.064 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 10042 18:16:27.069 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.068881 5779 minidump.cc:237] Setting minidump size limit to 20M 18:16:27.072 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.072605 5788 catalog_manager.cc:1049] Loading table and tablet metadata into memory... 18:16:27.088 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.088809 5788 catalog_manager.cc:1060] Initializing Kudu internal certificate authority... 18:16:27.116 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.116521 5779 tablet_server_main.cc:79] Initializing tablet server... 18:16:27.117 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.117414 5779 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 685139 18:16:27.117 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.117837 5779 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data/instance: No such file or directory (error 2) 18:16:27.118 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.118110 5779 server_base.cc:229] Creating new FS layout 18:16:27.120 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.120671 5779 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data/instance: 18:16:27.120 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" 18:16:27.121 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:27.132 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.132817 5779 fs_manager.cc:434] Time spent creating directory manager: real 0.011s user 0.004s sys 0.000s 18:16:27.133 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.133601 5779 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:27.133 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.133886 5779 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:27.152 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.152719 5779 fs_manager.cc:336] Time spent opening block manager: real 0.018s user 0.004s sys 0.000s 18:16:27.153 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.153254 5779 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:27.153 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" 18:16:27.153 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:27.153 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.153738 5779 fs_report.cc:347] Block manager report 18:16:27.153 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data/data 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:27.154 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:27.177 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.177340 5740 raft_consensus.cc:963] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [term 1 FOLLOWER]: Refusing update from remote peer cc55785a26934cc4ab3029ccde44c4dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 18:16:27.178 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.178020 5771 consensus_queue.cc:741] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [LEADER]: Connected to new peer: Peer: fc18203a324d4a5186ae7e258d85e029, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:27.180 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.180112 5659 raft_consensus.cc:963] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [term 1 FOLLOWER]: Refusing update from remote peer cc55785a26934cc4ab3029ccde44c4dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 18:16:27.181 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.180613 5771 consensus_queue.cc:741] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd [LEADER]: Connected to new peer: Peer: dbdab2d9d892423785874d17f429d296, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:27.197 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.196858 5773 sys_catalog.cc:321] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc55785a26934cc4ab3029ccde44c4dd. Latest consensus state: current_term: 1 leader_uuid: "cc55785a26934cc4ab3029ccde44c4dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.197 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.196892 5773 sys_catalog.cc:324] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: This master's current role is: FOLLOWER 18:16:27.197 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.197095 5774 sys_catalog.cc:321] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc55785a26934cc4ab3029ccde44c4dd. Latest consensus state: current_term: 1 leader_uuid: "cc55785a26934cc4ab3029ccde44c4dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.197 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.197118 5774 sys_catalog.cc:324] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: This master's current role is: FOLLOWER 18:16:27.213 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.212813 5774 sys_catalog.cc:321] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cc55785a26934cc4ab3029ccde44c4dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.213 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.212842 5774 sys_catalog.cc:324] T 00000000000000000000000000000000 P dbdab2d9d892423785874d17f429d296 [sys.catalog]: This master's current role is: FOLLOWER 18:16:27.217 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.216994 5779 ts_tablet_manager.cc:296] Loaded tablet metadata (0 live tablets) 18:16:27.217 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.217525 5779 tablet_server_main.cc:84] Starting tablet server... 18:16:27.218 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.214646 5788 catalog_manager.cc:947] Generated new certificate authority record 18:16:27.219 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.215529 5788 catalog_manager.cc:1069] Loading token signing keys... 18:16:27.225 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.224810 5773 sys_catalog.cc:321] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cc55785a26934cc4ab3029ccde44c4dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc55785a26934cc4ab3029ccde44c4dd" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "dbdab2d9d892423785874d17f429d296" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "fc18203a324d4a5186ae7e258d85e029" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:27.225 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.224839 5773 sys_catalog.cc:324] T 00000000000000000000000000000000 P fc18203a324d4a5186ae7e258d85e029 [sys.catalog]: This master's current role is: FOLLOWER 18:16:27.228 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.228248 5788 catalog_manager.cc:3648] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Generated new TSK 0 18:16:27.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.229358 5779 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64036 18:16:27.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.229748 5779 webserver.cc:149] Starting webserver on 127.20.121.1:64037 18:16:27.229 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.229959 5779 webserver.cc:160] Document root disabled 18:16:27.230 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.230418 5779 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64037/ 18:16:27.231 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.231576 5928 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:27.232 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.232022 5928 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:27.232 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.232259 5928 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:27.232 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.232723 5779 tablet_server_main.cc:87] Tablet server successfully started. 18:16:27.242 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.242426 5924 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:27.242 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.242496 5924 heartbeater.cc:387] Registering TS with master... 18:16:27.242 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.242600 5924 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:27.244 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.243310 5543 ts_manager.cc:81] Registered new tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:27.244 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.244388 5543 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:35865 18:16:27.245 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.245548 5926 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:27.245 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.245568 5926 heartbeater.cc:387] Registering TS with master... 18:16:27.245 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.245594 5926 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:27.246 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.246315 5729 ts_manager.cc:81] Registered new tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:27.249 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.249173 5650 ts_manager.cc:81] Registered new tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:27.249 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.248845 5925 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:27.249 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.248865 5925 heartbeater.cc:387] Registering TS with master... 18:16:27.249 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:27.248888 5925 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:27.412 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:27.428 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:27.412163 5949 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:27.430 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:27.430325 5949 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:27.444 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:27.444490 5949 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:27.445 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:27.444985 5949 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:27.446 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.446887 5949 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64038 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 18:16:27.447 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.5949 18:16:27.448 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:27.448 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:27.448 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:27.448 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:27.448 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/logs 18:16:27.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 18:16:27.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 18:16:27.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:27.453 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:27.453 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type RELEASE 18:16:27.453 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:27.453 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 10042 18:16:27.460 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.460397 5949 minidump.cc:237] Setting minidump size limit to 20M 18:16:27.492 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.488672 5949 tablet_server_main.cc:79] Initializing tablet server... 18:16:27.492 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.488991 5949 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 685139 18:16:27.492 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.489176 5949 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data/instance: No such file or directory (error 2) 18:16:27.492 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.489189 5949 server_base.cc:229] Creating new FS layout 18:16:27.493 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.491422 5949 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data/instance: 18:16:27.493 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "769021b95fba49269f11c58d171f33a6" 18:16:27.493 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:27.514 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.512601 5949 fs_manager.cc:434] Time spent creating directory manager: real 0.021s user 0.008s sys 0.000s 18:16:27.514 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.512892 5949 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:27.514 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.512939 5949 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:27.520 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.519563 5949 fs_manager.cc:336] Time spent opening block manager: real 0.006s user 0.000s sys 0.000s 18:16:27.520 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.519626 5949 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:27.520 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "769021b95fba49269f11c58d171f33a6" 18:16:27.520 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:27.520 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.519666 5949 fs_report.cc:347] Block manager report 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data/data 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:27.521 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:27.705 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.704955 5949 ts_tablet_manager.cc:296] Loaded tablet metadata (0 live tablets) 18:16:27.705 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.705119 5949 tablet_server_main.cc:84] Starting tablet server... 18:16:27.727 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.727107 5949 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64038 18:16:27.727 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.727186 5949 webserver.cc:149] Starting webserver on 127.20.121.1:64039 18:16:27.727 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.727195 5949 webserver.cc:160] Document root disabled 18:16:27.727 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.727425 5949 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64039/ 18:16:27.734 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.734848 6115 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:27.735 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.734917 6115 heartbeater.cc:387] Registering TS with master... 18:16:27.735 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.735020 6115 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:27.735 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.735275 5543 ts_manager.cc:81] Registered new tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:27.736 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:27.735808 5543 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:54056 18:16:27.739 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.739781 6116 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:27.740 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.739809 6116 heartbeater.cc:387] Registering TS with master... 18:16:27.740 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.739840 6116 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:27.740 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:27.740063 5650 ts_manager.cc:81] Registered new tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:27.744 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:27.745 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:27.744820 6005 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:27.745 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:27.745841 6005 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:27.746 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:27.745867 6005 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:27.746 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:27.745877 6005 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:27.752 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.752305 6118 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:27.752 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.752343 6118 heartbeater.cc:387] Registering TS with master... 18:16:27.752 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.752377 6118 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:27.752 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:27.752646 5729 ts_manager.cc:81] Registered new tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:27.761 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.761492 6005 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:27.761 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:27.762 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:27.762 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:27.762 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:27.762 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64040 18:16:27.762 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:27.762 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 18:16:27.762 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:27.763 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:27.763 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 18:16:27.763 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.6005 18:16:27.763 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:27.763 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:27.763 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:27.763 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:27.764 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/logs 18:16:27.764 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 18:16:27.764 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 18:16:27.764 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:27.764 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:27.764 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type RELEASE 18:16:27.764 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:27.767 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 10042 18:16:27.764 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.764520 6119 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:27.767 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.764549 6119 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:27.767 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.764555 6119 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:27.768 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:27.767804 5949 tablet_server_main.cc:87] Tablet server successfully started. 18:16:27.767 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.761826 6005 minidump.cc:237] Setting minidump size limit to 20M 18:16:27.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.763972 6005 tablet_server_main.cc:79] Initializing tablet server... 18:16:27.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.764226 6005 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 685139 18:16:27.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.764372 6005 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data/instance: No such file or directory (error 2) 18:16:27.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.764384 6005 server_base.cc:229] Creating new FS layout 18:16:27.768 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.766620 6005 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data/instance: 18:16:27.769 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "3476168b44e2452ebba1aa8d51aab35c" 18:16:27.769 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:27.786 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.786175 6005 fs_manager.cc:434] Time spent creating directory manager: real 0.019s user 0.000s sys 0.004s 18:16:27.786 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.786475 6005 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:27.786 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.786522 6005 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:27.787 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.787930 6005 fs_manager.cc:336] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s 18:16:27.788 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.787986 6005 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:27.798 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "3476168b44e2452ebba1aa8d51aab35c" 18:16:27.798 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:27.799 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.788072 6005 fs_report.cc:347] Block manager report 18:16:27.799 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 18:16:27.799 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data/data 18:16:27.799 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:27.799 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:27.799 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:27.799 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:27.800 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:27.800 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:27.800 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:27.800 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:27.800 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:27.800 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:27.810 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.810212 6005 ts_tablet_manager.cc:296] Loaded tablet metadata (0 live tablets) 18:16:27.810 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:27.810359 6005 tablet_server_main.cc:84] Starting tablet server... 18:16:28.085 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 18:16:28.140 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.140532 6005 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64040 18:16:28.140 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.140621 6005 webserver.cc:149] Starting webserver on 127.20.121.1:64041 18:16:28.141 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.140628 6005 webserver.cc:160] Document root disabled 18:16:28.141 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.140903 6005 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64041/ 18:16:28.182 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.182651 6264 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:28.183 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.182726 6264 heartbeater.cc:387] Registering TS with master... 18:16:28.183 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.182835 6264 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:28.184 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:28.183753 5543 ts_manager.cc:81] Registered new tserver with Master: 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040) 18:16:28.184 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:28.184386 5543 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:45135 18:16:28.192 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.192198 6271 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:28.192 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.192320 6278 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:28.192 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.192667 6271 heartbeater.cc:387] Registering TS with master... 18:16:28.193 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.192908 6271 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:28.193 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.193261 6278 heartbeater.cc:387] Registering TS with master... 18:16:28.193 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:28.193222 5650 ts_manager.cc:81] Registered new tserver with Master: 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040) 18:16:28.193 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.193470 6278 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:28.193 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:28.193864 5729 ts_manager.cc:81] Registered new tserver with Master: 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040) 18:16:28.195 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.195148 6005 tablet_server_main.cc:87] Tablet server successfully started. 18:16:28.195 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.195065 6280 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:28.195 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.195192 6280 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:28.195 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:28.195199 6280 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:28.245 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:28.245467 5924 heartbeater.cc:406] Master 127.20.121.1:64030 was elected leader, sending a full tablet report... 18:16:28.736 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:28.736601 6115 heartbeater.cc:406] Master 127.20.121.1:64030 was elected leader, sending a full tablet report... 18:16:29.185 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:29.185465 6264 heartbeater.cc:406] Master 127.20.121.1:64030 was elected leader, sending a full tablet report... 18:16:29.513 [INFO - main] (BaseKuduTest.java:117) Creating new Kudu client... 18:16:29.517 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 18:16:30.464 [INFO - main] (BaseKuduTest.java:123) Waiting for tablet servers... 18:16:31.038 [DEBUG - New I/O worker #3] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:31.039 [DEBUG - New I/O worker #1] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:31.046 [DEBUG - New I/O worker #2] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:31.395 [DEBUG - New I/O worker #1] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 18:16:31.396 [DEBUG - New I/O worker #1] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=726), Traces: [0ms] querying master, [113ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64030, [240ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64032, [257ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64034, [663ms] Sub rpc: ConnectToMaster received from server master-127.20.121.1:64032 response OK, [664ms] Sub rpc: ConnectToMaster received from server master-127.20.121.1:64034 response OK, [664ms] Sub rpc: ConnectToMaster received from server master-127.20.121.1:64030 response OK, null) after lookup 18:16:31.434 [DEBUG - New I/O worker #1] (Deferred.java:1330) callback=retry RPC@526802776 returned Deferred@856871279(state=PENDING, result=null, callback=(continuation of Deferred@1533174919 after retry RPC@526802776), errback=(continuation of Deferred@1533174919 after retry RPC@526802776)), so the following Deferred is getting paused: Deferred@1533174919(state=PAUSED, result=Deferred@856871279, callback=wakeup thread main, errback=wakeup thread main) 18:16:31.518 [INFO - main] (BaseKuduTest.java:131) Creating table: org.apache.kudu.client.TestAsyncKuduSession-1505931385592 18:16:31.558 [DEBUG - main] (NetUtil.java:103) Resolved IP of `127.20.121.1' to /127.20.121.1 in 12370376ns 18:16:31.559 [DEBUG - New I/O worker #66] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:31.600 [DEBUG - New I/O worker #68] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:31.601 [DEBUG - New I/O worker #67] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:31.623 [DEBUG - New I/O worker #66] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 18:16:31.624 [DEBUG - New I/O worker #66] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=94), Traces: [0ms] querying master, [15ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64030, [29ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64032, [30ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64034, [92ms] Sub rpc: ConnectToMaster received from server master-127.20.121.1:64030 response OK, null) after lookup 18:16:31.631 [DEBUG - New I/O worker #66] (Deferred.java:1330) callback=retry RPC@1307328578 returned Deferred@149870491(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after retry RPC@1307328578), errback=(continuation of Deferred@1850028047 after retry RPC@1307328578)), so the following Deferred is getting paused: Deferred@1850028047(state=PAUSED, result=Deferred@149870491, callback=org.apache.kudu.client.AsyncKuduClient$1@392cdeba -> org.apache.kudu.client.AsyncKuduClient$2@166d678d -> wakeup thread main, errback=passthrough -> passthrough -> wakeup thread main) 18:16:31.656 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:31.656817 5543 catalog_manager.cc:1312] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:38167: 18:16:31.657 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "org.apache.kudu.client.TestAsyncKuduSession-1505931385592" 18:16:31.657 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) schema { 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "key" 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: true 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column1_i" 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:31.658 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column2_i" 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column3_s" 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: STRING 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:31.659 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: true 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) compression: LZ4 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 4096 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column4_b" 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: BOOL 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.660 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) partition_schema { 18:16:31.661 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) range_schema { 18:16:31.661 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:31.661 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "key" 18:16:31.661 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.661 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.661 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:31.706 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@392cdeba@959241914 returned Deferred@121754110(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@63a31e18 -> (continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$1@392cdeba@959241914), errback=passthrough -> (continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$1@392cdeba@959241914)), so the following Deferred is getting paused: Deferred@1850028047(state=PAUSED, result=Deferred@121754110, callback=org.apache.kudu.client.AsyncKuduClient$2@166d678d -> wakeup thread main, errback=passthrough -> wakeup thread main) 18:16:31.716 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:571) Opened table 0c7ce07eeea84d93b9986bafd95c74d3 18:16:31.718 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685 returned Deferred@474292052(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685), errback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685)), so the following Deferred is getting paused: Deferred@1850028047(state=PAUSED, result=Deferred@474292052, callback=wakeup thread main, errback=wakeup thread main) 18:16:31.736 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330 returned Deferred@474292052(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330), errback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330)), so the following Deferred is getting paused: Deferred@1293976674(state=PAUSED, result=Deferred@474292052, callback=, errback=) 18:16:31.749 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087 returned Deferred@474292052(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087), errback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087)), so the following Deferred is getting paused: Deferred@2075835738(state=PAUSED, result=Deferred@474292052, callback=, errback=) 18:16:31.768 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950 returned Deferred@474292052(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950), errback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950)), so the following Deferred is getting paused: Deferred@958308250(state=PAUSED, result=Deferred@474292052, callback=, errback=) 18:16:31.782 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.782722 6178 tablet_service.cc:765] Processing CreateTablet for tablet 5ceb1b36c63b4045be78db7318693bc3 (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=0c7ce07eeea84d93b9986bafd95c74d3]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:31.784 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.782227 6052 tablet_service.cc:765] Processing CreateTablet for tablet 5ceb1b36c63b4045be78db7318693bc3 (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=0c7ce07eeea84d93b9986bafd95c74d3]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:31.785 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.781958 5858 tablet_service.cc:765] Processing CreateTablet for tablet 5ceb1b36c63b4045be78db7318693bc3 (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=0c7ce07eeea84d93b9986bafd95c74d3]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:31.785 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.784441 5858 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Registered tablet (data state: TABLET_DATA_READY) 18:16:31.784 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.784788 6178 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Registered tablet (data state: TABLET_DATA_READY) 18:16:31.786 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.785346 6052 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Registered tablet (data state: TABLET_DATA_READY) 18:16:31.795 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.788467 6981 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrapping tablet 18:16:31.795 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.788571 6981 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrap starting. 18:16:31.795 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.789077 6981 tablet_bootstrap.cc:567] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: No blocks or log segments found. Creating new log. 18:16:31.795 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.789348 6981 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Log is configured to *not* fsync() on all Append() calls 18:16:31.796 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.793568 6981 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: No bootstrap required, opened a new log 18:16:31.796 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.793620 6981 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s 18:16:31.796 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522 returned Deferred@474292052(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950) -> (continuation of Deferred@1437672764 after org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522), errback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950) -> (continuation of Deferred@1437672764 after org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522)), so the following Deferred is getting paused: Deferred@1437672764(state=PAUSED, result=Deferred@474292052, callback=, errback=) 18:16:31.796 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.793975 6981 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:31.796 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.794006 6981 raft_consensus.cc:312] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:31.797 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.794065 6981 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769021b95fba49269f11c58d171f33a6, State: Initialized, Role: FOLLOWER 18:16:31.797 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.794102 6981 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:31.797 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.794464 6981 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s 18:16:31.801 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.800969 6980 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrapping tablet 18:16:31.802 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.802116 6980 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrap starting. 18:16:31.802 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.802647 6980 tablet_bootstrap.cc:567] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: No blocks or log segments found. Creating new log. 18:16:31.803 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.802920 6980 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Log is configured to *not* fsync() on all Append() calls 18:16:31.804 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.804548 6977 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrapping tablet 18:16:31.804 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.804836 6977 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap starting. 18:16:31.805 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.805392 6977 tablet_bootstrap.cc:567] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: No blocks or log segments found. Creating new log. 18:16:31.805 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.805631 6977 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Log is configured to *not* fsync() on all Append() calls 18:16:31.817 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.816996 6977 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: No bootstrap required, opened a new log 18:16:31.817 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.817008 6980 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: No bootstrap required, opened a new log 18:16:31.817 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.817250 6980 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.000s 18:16:31.817 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.817565 6977 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.000s 18:16:31.817 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.817908 6980 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:31.818 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.817978 6977 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:31.818 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.818081 6977 raft_consensus.cc:312] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:31.818 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.818174 6977 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Initialized, Role: FOLLOWER 18:16:31.818 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.818210 6977 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:31.818 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.818603 6980 raft_consensus.cc:312] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:31.819 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.818713 6980 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3476168b44e2452ebba1aa8d51aab35c, State: Initialized, Role: FOLLOWER 18:16:31.819 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.818745 6980 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:31.829 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@506eeca@84340426 returned Deferred@474292052(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950) -> (continuation of Deferred@1437672764 after org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522) -> (continuation of Deferred@1219052479 after org.apache.kudu.client.AsyncKuduClient$12@506eeca@84340426), errback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950) -> (continuation of Deferred@1437672764 after org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522) -> (continuation of Deferred@1219052479 after org.apache.kudu.client.AsyncKuduClient$12@506eeca@84340426)), so the following Deferred is getting paused: Deferred@1219052479(state=PAUSED, result=Deferred@474292052, callback=, errback=) 18:16:31.833 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.833650 6980 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Time spent starting tablet: real 0.016s user 0.000s sys 0.004s 18:16:31.834 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.834297 6977 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent starting tablet: real 0.017s user 0.000s sys 0.000s 18:16:31.848 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@4bdeb95f@1272887647 returned Deferred@474292052(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950) -> (continuation of Deferred@1437672764 after org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522) -> (continuation of Deferred@1219052479 after org.apache.kudu.client.AsyncKuduClient$12@506eeca@84340426) -> (continuation of Deferred@396029405 after org.apache.kudu.client.AsyncKuduClient$12@4bdeb95f@1272887647), errback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950) -> (continuation of Deferred@1437672764 after org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522) -> (continuation of Deferred@1219052479 after org.apache.kudu.client.AsyncKuduClient$12@506eeca@84340426) -> (continuation of Deferred@396029405 after org.apache.kudu.client.AsyncKuduClient$12@4bdeb95f@1272887647)), so the following Deferred is getting paused: Deferred@396029405(state=PAUSED, result=Deferred@474292052, callback=, errback=) 18:16:31.868 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.867570 6994 raft_consensus.cc:411] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 18:16:31.868 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.867641 6994 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 1.811s (starting election) 18:16:31.868 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.867738 6994 raft_consensus.cc:433] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:31.869 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.867959 6994 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 769021b95fba49269f11c58d171f33a6 18:16:31.869 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.868028 6994 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 3476168b44e2452ebba1aa8d51aab35c 18:16:31.870 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@25d8315a@634925402 returned Deferred@474292052(state=PENDING, result=null, callback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950) -> (continuation of Deferred@1437672764 after org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522) -> (continuation of Deferred@1219052479 after org.apache.kudu.client.AsyncKuduClient$12@506eeca@84340426) -> (continuation of Deferred@396029405 after org.apache.kudu.client.AsyncKuduClient$12@4bdeb95f@1272887647) -> (continuation of Deferred@661531365 after org.apache.kudu.client.AsyncKuduClient$12@25d8315a@634925402), errback=(continuation of Deferred@1850028047 after org.apache.kudu.client.AsyncKuduClient$2@166d678d@376268685) -> (continuation of Deferred@1293976674 after org.apache.kudu.client.AsyncKuduClient$12@67ed811a@1743618330) -> (continuation of Deferred@2075835738 after org.apache.kudu.client.AsyncKuduClient$12@4fb1b447@1337046087) -> (continuation of Deferred@958308250 after org.apache.kudu.client.AsyncKuduClient$12@70541666@1884558950) -> (continuation of Deferred@1437672764 after org.apache.kudu.client.AsyncKuduClient$12@7bcf1772@2077169522) -> (continuation of Deferred@1219052479 after org.apache.kudu.client.AsyncKuduClient$12@506eeca@84340426) -> (continuation of Deferred@396029405 after org.apache.kudu.client.AsyncKuduClient$12@4bdeb95f@1272887647) -> (continuation of Deferred@661531365 after org.apache.kudu.client.AsyncKuduClient$12@25d8315a@634925402)), so the following Deferred is getting paused: Deferred@661531365(state=PAUSED, result=Deferred@474292052, callback=, errback=) 18:16:31.894 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.894215 6198 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "5ceb1b36c63b4045be78db7318693bc3" candidate_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3476168b44e2452ebba1aa8d51aab35c" is_pre_election: true 18:16:31.894 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.894513 5798 leader_election.cc:353] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 pre-election: Vote granted by peer 3476168b44e2452ebba1aa8d51aab35c 18:16:31.895 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.894543 5798 leader_election.cc:248] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 18:16:31.895 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.894623 6994 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 1.649s (election complete) 18:16:31.895 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.894650 6994 raft_consensus.cc:2279] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Leader pre-election won for term 1 18:16:31.895 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.894665 6994 raft_consensus.cc:411] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 18:16:31.895 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.894672 6994 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 1.860s (starting election) 18:16:31.895 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.894680 6994 raft_consensus.cc:2507] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Advancing to term 1 18:16:31.896 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.895298 5808 leader_election.cc:353] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 pre-election: Vote granted by peer 769021b95fba49269f11c58d171f33a6 18:16:31.896 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.895454 6994 raft_consensus.cc:433] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:31.896 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.895596 6994 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 election: Requesting vote from peer 769021b95fba49269f11c58d171f33a6 18:16:31.896 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.895632 6994 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 election: Requesting vote from peer 3476168b44e2452ebba1aa8d51aab35c 18:16:31.895 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.895015 6072 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "5ceb1b36c63b4045be78db7318693bc3" candidate_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769021b95fba49269f11c58d171f33a6" is_pre_election: true 18:16:31.897 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.895098 6072 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Snoozing failure detection for 1.516s (vote granted) 18:16:31.898 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.895123 6072 raft_consensus.cc:2009] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed5a3ca82f6c4c88aeeca222d59ff40a in term 0. 18:16:31.894 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.894312 6198 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Snoozing failure detection for 1.737s (vote granted) 18:16:31.898 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.894340 6198 raft_consensus.cc:2009] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed5a3ca82f6c4c88aeeca222d59ff40a in term 0. 18:16:31.898 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.896555 6198 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "5ceb1b36c63b4045be78db7318693bc3" candidate_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3476168b44e2452ebba1aa8d51aab35c" 18:16:31.898 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.896581 6198 raft_consensus.cc:2507] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Advancing to term 1 18:16:31.898 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.896613 6198 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Snoozing failure detection for 1.513s (vote granted) 18:16:31.898 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:31.897231 6198 raft_consensus.cc:2009] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed5a3ca82f6c4c88aeeca222d59ff40a in term 1. 18:16:31.898 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.895777 6072 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "5ceb1b36c63b4045be78db7318693bc3" candidate_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769021b95fba49269f11c58d171f33a6" 18:16:31.899 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.895800 6072 raft_consensus.cc:2507] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Advancing to term 1 18:16:31.899 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.895829 6072 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Snoozing failure detection for 1.656s (vote granted) 18:16:31.899 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:31.896486 6072 raft_consensus.cc:2009] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed5a3ca82f6c4c88aeeca222d59ff40a in term 1. 18:16:31.896 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.896608 5808 leader_election.cc:353] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 election: Vote granted by peer 769021b95fba49269f11c58d171f33a6 18:16:31.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.896627 5808 leader_election.cc:248] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 18:16:31.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.896674 6994 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 1.951s (election complete) 18:16:31.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.896690 6994 raft_consensus.cc:2279] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Leader election won for term 1 18:16:31.899 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.897336 5798 leader_election.cc:353] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 election: Vote granted by peer 3476168b44e2452ebba1aa8d51aab35c 18:16:31.904 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.904554 6994 raft_consensus.cc:541] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 LEADER]: Becoming Leader. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Running, Role: LEADER 18:16:31.904 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:31.904708 6994 consensus_queue.cc:169] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:31.921 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:31.921265 5543 catalog_manager.cc:2615] T 5ceb1b36c63b4045be78db7318693bc3 reported cstate change: term changed from 0 to 1, leader changed from to ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1). New cstate: current_term: 1 leader_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } 18:16:32.004 [DEBUG - main] (AsyncKuduClient.java:1287) Cannot continue with RPC because of: Timed out: can not complete before timeout: KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=1, elapsed=3), No traces, null) 18:16:32.015 [DEBUG - main] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@107456312(state=PENDING, result=null, callback=, errback=)} 18:16:32.018 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet 5ceb1b36c63b4045be78db7318693bc3 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:32.027 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=5ceb1b36c63b4045be78db7318693bc3, ttl=299991}] 18:16:32.047 [ERROR - New I/O boss #130] (Connection.java:436) [peer ed5a3ca82f6c4c88aeeca222d59ff40a] unexpected exception from downstream on [id: 0x1873954d] java.net.ConnectException: Connection refused: /127.20.121.1:64036 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 18:16:32.048 [DEBUG - New I/O worker #70] (Connection.java:666) [peer ed5a3ca82f6c4c88aeeca222d59ff40a] cleaning up while in state CONNECTING due to: connection closed 18:16:32.047 [DEBUG - main] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@400cff1a@1074593562 returned Deferred@660017404(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1381965390 after org.apache.kudu.client.AsyncKuduSession$1@400cff1a@1074593562), errback=passthrough -> (continuation of Deferred@1381965390 after org.apache.kudu.client.AsyncKuduSession$1@400cff1a@1074593562)), so the following Deferred is getting paused: Deferred@1381965390(state=PAUSED, result=Deferred@660017404, callback=, errback=) 18:16:32.059 [INFO - New I/O worker #70] (AsyncKuduClient.java:1582) Removing server ed5a3ca82f6c4c88aeeca222d59ff40a from this tablet's cache 5ceb1b36c63b4045be78db7318693bc3 18:16:32.061 [DEBUG - New I/O worker #70] (AsyncKuduClient.java:1287) Cannot continue with RPC because of: Timed out: can not complete before timeout: Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=5ceb1b36c63b4045be78db7318693bc3, attempt=1, DeadlineTracker(timeout=1, elapsed=29), Traces: [0ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [19ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Network error: connection closed, [28ms] delaying RPC due to Network error: connection closed, Deferred@76485402(state=PENDING, result=null, callback=apply batch response -> notify DeferredGroup@172555771, errback=apply batch error response -> notify DeferredGroup@172555771))} 18:16:32.161 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:32.180 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:32.161247 7250 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:32.177620 7250 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:32.177645 7250 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:32.177656 7250 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.178915 7250 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64036 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:32.181 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.7250 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/logs 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:32.182 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type RELEASE 18:16:32.183 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:32.183 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 10042 18:16:32.183 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.179167 7250 minidump.cc:237] Setting minidump size limit to 20M 18:16:32.236 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.236568 7250 tablet_server_main.cc:79] Initializing tablet server... 18:16:32.236 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.236897 7250 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 687639 18:16:32.256 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.256783 7250 fs_manager.cc:324] Time spent opening directory manager: real 0.019s user 0.000s sys 0.004s 18:16:32.257 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.256873 7250 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:32.257 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.256922 7250 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:32.272 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.272284 7250 fs_manager.cc:336] Time spent opening block manager: real 0.014s user 0.004s sys 0.000s 18:16:32.272 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.272898 7250 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.272954 7250 fs_report.cc:347] Block manager report 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data/data 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:32.273 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:32.274 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:32.381 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.381048 7250 ts_tablet_manager.cc:284] Loading tablet metadata (0/1 complete) 18:16:32.381 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.381088 7250 ts_tablet_manager.cc:855] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Loading tablet metadata 18:16:32.381 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.381932 7250 ts_tablet_manager.cc:296] Loaded tablet metadata (1 live tablets) 18:16:32.382 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.382714 7250 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Registered tablet (data state: TABLET_DATA_READY) 18:16:32.396 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.396625 7403 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrapping tablet 18:16:32.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.397056 7403 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap starting. 18:16:32.398 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.398586 7403 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Log is configured to *not* fsync() on all Append() calls 18:16:32.404 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.404587 7250 tablet_server_main.cc:84] Starting tablet server... 18:16:32.417 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.417513 7403 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates 18:16:32.418 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.418143 7403 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap complete. 18:16:32.418 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.418437 7403 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.000s 18:16:32.419 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.419720 7403 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:32.421 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.421805 7403 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Initialized, Role: FOLLOWER 18:16:32.422 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.422049 7403 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:32.428 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.428714 7403 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent starting tablet: real 0.010s user 0.000s sys 0.004s 18:16:32.525 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:32.526 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:32.525463 7410 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:32.526 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:32.526587 7410 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:32.526 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:32.526604 7410 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:32.526 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:32.526613 7410 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:32.527 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.527887 7410 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64038 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.7410 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:32.528 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/logs 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type RELEASE 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:32.529 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 10042 18:16:32.548 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.548537 7410 minidump.cc:237] Setting minidump size limit to 20M 18:16:32.564 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.564476 7410 tablet_server_main.cc:79] Initializing tablet server... 18:16:32.565 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.565059 7410 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 687639 18:16:32.604 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.604090 7410 fs_manager.cc:324] Time spent opening directory manager: real 0.038s user 0.004s sys 0.000s 18:16:32.605 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.604492 7410 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:32.605 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.604547 7410 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:32.605 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.605917 7410 fs_manager.cc:336] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s 18:16:32.606 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.606598 7410 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:32.606 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "769021b95fba49269f11c58d171f33a6" 18:16:32.606 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:32.606 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.606947 7410 fs_report.cc:347] Block manager report 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data/data 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:32.607 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:32.849 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:32.850 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:32.849696 7497 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:32.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:32.851230 7497 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:32.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:32.851409 7497 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:32.851 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:32.851558 7497 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.853057 7497 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64040 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.7497 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:32.853 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/logs 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type RELEASE 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 10042 18:16:32.854 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.854960 7497 minidump.cc:237] Setting minidump size limit to 20M 18:16:32.857 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.857375 7497 tablet_server_main.cc:79] Initializing tablet server... 18:16:32.857 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.857811 7497 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 687639 18:16:32.859 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.859525 7497 fs_manager.cc:324] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s 18:16:32.859 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.859740 7497 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:32.859 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.859925 7497 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:32.861 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.861392 7497 fs_manager.cc:336] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.862040 7497 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "3476168b44e2452ebba1aa8d51aab35c" 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.862383 7497 fs_report.cc:347] Block manager report 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data/data 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:32.862 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:32.863 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:32.863 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:32.863 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:32.863 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:32.864 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.864924 7410 ts_tablet_manager.cc:284] Loading tablet metadata (0/1 complete) 18:16:32.865 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.865170 7410 ts_tablet_manager.cc:855] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Loading tablet metadata 18:16:32.866 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.866152 7410 ts_tablet_manager.cc:296] Loaded tablet metadata (1 live tablets) 18:16:32.867 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.867450 7410 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Registered tablet (data state: TABLET_DATA_READY) 18:16:32.884 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.884755 7410 tablet_server_main.cc:84] Starting tablet server... 18:16:32.886 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.886147 7591 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrapping tablet 18:16:32.886 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.886633 7591 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrap starting. 18:16:32.891 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.890908 7591 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Log is configured to *not* fsync() on all Append() calls 18:16:32.897 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.897478 7591 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 18:16:32.898 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.898108 7591 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrap complete. 18:16:32.898 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.898478 7591 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.000s 18:16:32.900 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.900454 7591 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:32.900 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.900868 7591 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769021b95fba49269f11c58d171f33a6, State: Initialized, Role: FOLLOWER 18:16:32.901 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.901129 7591 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:32.912 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:32.912825 7591 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s 18:16:32.916 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.916496 7497 ts_tablet_manager.cc:284] Loading tablet metadata (0/1 complete) 18:16:32.917 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.916590 7497 ts_tablet_manager.cc:855] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Loading tablet metadata 18:16:32.917 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.917374 7497 ts_tablet_manager.cc:296] Loaded tablet metadata (1 live tablets) 18:16:32.918 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.918133 7497 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Registered tablet (data state: TABLET_DATA_READY) 18:16:32.918 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.918447 7624 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrapping tablet 18:16:32.918 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.918704 7624 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrap starting. 18:16:32.920 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.920140 7624 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Log is configured to *not* fsync() on all Append() calls 18:16:32.920 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.920485 7497 tablet_server_main.cc:84] Starting tablet server... 18:16:32.922 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.920794 7624 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 18:16:32.922 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.920924 7624 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrap complete. 18:16:32.922 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.921020 7624 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s 18:16:32.922 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.922066 7624 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:32.922 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.922158 7624 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3476168b44e2452ebba1aa8d51aab35c, State: Initialized, Role: FOLLOWER 18:16:32.922 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.922194 7624 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:32.936 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:32.936659 7624 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Time spent starting tablet: real 0.016s user 0.000s sys 0.004s 18:16:32.989 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.989153 7250 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64036 18:16:32.990 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.989262 7250 webserver.cc:149] Starting webserver on 127.20.121.1:64037 18:16:32.990 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.989271 7250 webserver.cc:160] Document root disabled 18:16:32.990 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.989477 7250 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64037/ 18:16:32.991 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.991466 7250 tablet_server_main.cc:87] Tablet server successfully started. 18:16:32.991 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.991621 7705 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:32.991 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.991669 7705 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:32.991 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:32.991677 7705 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:33.015 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.015383 7698 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:33.015 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.015457 7698 heartbeater.cc:387] Registering TS with master... 18:16:33.015 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.015560 7698 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:33.016 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:33.015915 5650 ts_manager.cc:87] Re-registered known tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:33.017 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.017360 7702 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:33.017 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.017410 7702 heartbeater.cc:387] Registering TS with master... 18:16:33.017 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.017477 7702 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:33.017 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.017539 7696 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:33.017 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.017556 7696 heartbeater.cc:387] Registering TS with master... 18:16:33.017 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.017596 7696 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:33.017 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:33.017729 5729 ts_manager.cc:87] Re-registered known tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:33.018 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.017805 5543 ts_manager.cc:87] Re-registered known tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:33.018 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.018527 5543 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:56507 18:16:33.033 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.033252 7410 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64038 18:16:33.033 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.033725 7410 webserver.cc:149] Starting webserver on 127.20.121.1:64039 18:16:33.033 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.033905 7410 webserver.cc:160] Document root disabled 18:16:33.034 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.034312 7410 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64039/ 18:16:33.056 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.056711 7838 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:33.057 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.056740 7838 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:33.057 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.056746 7838 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:33.062 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.062433 7831 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:33.063 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.062608 7831 heartbeater.cc:387] Registering TS with master... 18:16:33.063 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.062716 7831 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:33.063 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.063304 7836 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:33.063 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.063324 7836 heartbeater.cc:387] Registering TS with master... 18:16:33.063 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.063361 7836 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:33.063 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:33.063634 5729 ts_manager.cc:87] Re-registered known tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:33.063 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:33.063634 5650 ts_manager.cc:87] Re-registered known tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:33.063 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.063915 7410 tablet_server_main.cc:87] Tablet server successfully started. 18:16:33.065 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.065572 7829 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:33.065 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.065608 7829 heartbeater.cc:387] Registering TS with master... 18:16:33.065 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.065649 7829 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:33.066 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.065836 5543 ts_manager.cc:87] Re-registered known tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:33.066 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.066566 5543 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:40919 18:16:33.112 [INFO - Time-limited test] (BaseKuduTest.java:131) Creating table: non-replicated 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.115928 5543 catalog_manager.cc:1312] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:38167: 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "non-replicated" 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) schema { 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "key" 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: true 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:33.116 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column1_i" 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column2_i" 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:33.117 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column3_s" 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: STRING 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: true 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) compression: LZ4 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 4096 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column4_b" 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: BOOL 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:33.118 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) num_replicas: 1 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) partition_schema { 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) range_schema { 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "key" 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.119 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:33.127 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@64a7b587@1688712583 returned Deferred@1547561069(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@624edde5 -> (continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$1@64a7b587@1688712583), errback=passthrough -> (continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$1@64a7b587@1688712583)), so the following Deferred is getting paused: Deferred@25969141(state=PAUSED, result=Deferred@1547561069, callback=org.apache.kudu.client.AsyncKuduClient$2@585ed7ce -> wakeup thread Time-limited test, errback=passthrough -> wakeup thread Time-limited test) 18:16:33.129 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:571) Opened table a376925c53624b9d95de8b949fdf3869 18:16:33.129 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638 returned Deferred@1796416040(state=PENDING, result=null, callback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638), errback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638)), so the following Deferred is getting paused: Deferred@25969141(state=PAUSED, result=Deferred@1796416040, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 18:16:33.130 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.129338 7528 tablet_service.cc:765] Processing CreateTablet for tablet ebc65b53aa524c72b3aa9390d0769cc3 (table=non-replicated [id=a376925c53624b9d95de8b949fdf3869]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:33.139 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.136387 7528 ts_tablet_manager.cc:1028] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Registered tablet (data state: TABLET_DATA_READY) 18:16:33.149 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986 returned Deferred@1796416040(state=PENDING, result=null, callback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986), errback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986)), so the following Deferred is getting paused: Deferred@482746034(state=PAUSED, result=Deferred@1796416040, callback=, errback=) 18:16:33.168 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707 returned Deferred@1796416040(state=PENDING, result=null, callback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986) -> (continuation of Deferred@1081617496 after org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707), errback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986) -> (continuation of Deferred@1081617496 after org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707)), so the following Deferred is getting paused: Deferred@1081617496(state=PAUSED, result=Deferred@1796416040, callback=, errback=) 18:16:33.188 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@c48e3a6@206103462 returned Deferred@1796416040(state=PENDING, result=null, callback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986) -> (continuation of Deferred@1081617496 after org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707) -> (continuation of Deferred@550981395 after org.apache.kudu.client.AsyncKuduClient$12@c48e3a6@206103462), errback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986) -> (continuation of Deferred@1081617496 after org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707) -> (continuation of Deferred@550981395 after org.apache.kudu.client.AsyncKuduClient$12@c48e3a6@206103462)), so the following Deferred is getting paused: Deferred@550981395(state=PAUSED, result=Deferred@1796416040, callback=, errback=) 18:16:33.196 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.196491 7878 ts_tablet_manager.cc:878] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrapping tablet 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.196583 7878 tablet_bootstrap.cc:432] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap starting. 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197021 7878 tablet_bootstrap.cc:567] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: No blocks or log segments found. Creating new log. 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197593 7878 tablet_bootstrap.cc:432] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: No bootstrap required, opened a new log 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197641 7878 ts_tablet_manager.cc:903] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197849 7878 raft_consensus.cc:286] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197863 7878 raft_consensus.cc:312] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197906 7878 raft_consensus.cc:575] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Initialized, Role: FOLLOWER 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197926 7878 consensus_queue.cc:190] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:33.199 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197942 7878 raft_consensus.cc:327] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately 18:16:33.200 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197962 7878 raft_consensus.cc:411] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) 18:16:33.200 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.197990 7878 raft_consensus.cc:2455] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 2.212s (starting election) 18:16:33.200 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.198005 7878 raft_consensus.cc:2507] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Advancing to term 1 18:16:33.200 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.198734 7878 raft_consensus.cc:433] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:33.200 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.198801 7878 leader_election.cc:248] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 18:16:33.210 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@507dc318@1350419224 returned Deferred@1796416040(state=PENDING, result=null, callback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986) -> (continuation of Deferred@1081617496 after org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707) -> (continuation of Deferred@550981395 after org.apache.kudu.client.AsyncKuduClient$12@c48e3a6@206103462) -> (continuation of Deferred@1365655459 after org.apache.kudu.client.AsyncKuduClient$12@507dc318@1350419224), errback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986) -> (continuation of Deferred@1081617496 after org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707) -> (continuation of Deferred@550981395 after org.apache.kudu.client.AsyncKuduClient$12@c48e3a6@206103462) -> (continuation of Deferred@1365655459 after org.apache.kudu.client.AsyncKuduClient$12@507dc318@1350419224)), so the following Deferred is getting paused: Deferred@1365655459(state=PAUSED, result=Deferred@1796416040, callback=, errback=) 18:16:33.224 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.224627 7878 ts_tablet_manager.cc:931] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent starting tablet: real 0.027s user 0.000s sys 0.004s 18:16:33.225 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.224716 7696 heartbeater.cc:406] Master 127.20.121.1:64030 was elected leader, sending a full tablet report... 18:16:33.227 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.227115 7893 raft_consensus.cc:2455] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 1.634s (election complete) 18:16:33.227 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.227180 7893 raft_consensus.cc:2279] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Leader election won for term 1 18:16:33.227 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.227380 7893 raft_consensus.cc:541] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 LEADER]: Becoming Leader. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Running, Role: LEADER 18:16:33.227 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.227530 7893 consensus_queue.cc:169] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:33.228 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@1af8b3fa@452506618 returned Deferred@1796416040(state=PENDING, result=null, callback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986) -> (continuation of Deferred@1081617496 after org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707) -> (continuation of Deferred@550981395 after org.apache.kudu.client.AsyncKuduClient$12@c48e3a6@206103462) -> (continuation of Deferred@1365655459 after org.apache.kudu.client.AsyncKuduClient$12@507dc318@1350419224) -> (continuation of Deferred@13490273 after org.apache.kudu.client.AsyncKuduClient$12@1af8b3fa@452506618), errback=(continuation of Deferred@25969141 after org.apache.kudu.client.AsyncKuduClient$2@585ed7ce@1482610638) -> (continuation of Deferred@482746034 after org.apache.kudu.client.AsyncKuduClient$12@7fa67b5a@2141616986) -> (continuation of Deferred@1081617496 after org.apache.kudu.client.AsyncKuduClient$12@32884a43@847792707) -> (continuation of Deferred@550981395 after org.apache.kudu.client.AsyncKuduClient$12@c48e3a6@206103462) -> (continuation of Deferred@1365655459 after org.apache.kudu.client.AsyncKuduClient$12@507dc318@1350419224) -> (continuation of Deferred@13490273 after org.apache.kudu.client.AsyncKuduClient$12@1af8b3fa@452506618)), so the following Deferred is getting paused: Deferred@13490273(state=PAUSED, result=Deferred@1796416040, callback=, errback=) 18:16:33.246 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.245857 5543 catalog_manager.cc:2615] T ebc65b53aa524c72b3aa9390d0769cc3 reported cstate change: term changed from 0 to 1, leader changed from to ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1). New cstate: current_term: 1 leader_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } } 18:16:33.272 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet ebc65b53aa524c72b3aa9390d0769cc3 for table 'non-replicated' with partition [, ) 18:16:33.273 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=ebc65b53aa524c72b3aa9390d0769cc3, ttl=299999}] 18:16:33.273 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, DeadlineTracker(timeout=30000, elapsed=4), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [1ms] Sub rpc: GetTableLocations received from server response OK, null) after lookup 18:16:33.276 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1592595749 returned Deferred@30739041(state=PENDING, result=null, callback=(continuation of Deferred@1874183402 after retry RPC@1592595749), errback=(continuation of Deferred@1874183402 after retry RPC@1592595749)), so the following Deferred is getting paused: Deferred@1874183402(state=PAUSED, result=Deferred@30739041, callback=passthrough -> wakeup thread Time-limited test, errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@645b9ad9 -> wakeup thread Time-limited test) 18:16:33.396 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) *** Aborted at 1505931393 (unix time) try "date -d @1505931393" if you are using GNU date *** 18:16:33.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) PC: @ 0x7f98f2ee8d4d nanosleep 18:16:33.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) *** SIGTERM (@0x3e800001479) received by PID 7250 (TID 0x7f98f4f37880) from PID 5241; stack trace: *** 18:16:33.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) @ 0x7f98f2e5acb0 (unknown) 18:16:33.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) @ 0x7f98f2ee8d4d nanosleep 18:16:33.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) @ 0x7f98f3970718 base::SleepForNanoseconds() 18:16:33.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) @ 0x4024ec kudu::tserver::TabletServerMain() 18:16:33.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) @ 0x7f98f2e45f45 __libc_start_main 18:16:33.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) @ 0x40208d (unknown) 18:16:33.412 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) *** Aborted at 1505931393 (unix time) try "date -d @1505931393" if you are using GNU date *** 18:16:33.413 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) PC: @ 0x7fc712569d4d nanosleep 18:16:33.413 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) *** SIGTERM (@0x3e800001479) received by PID 7410 (TID 0x7fc7145b8880) from PID 5241; stack trace: *** 18:16:33.413 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7fc7124dbcb0 (unknown) 18:16:33.413 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7fc712569d4d nanosleep 18:16:33.413 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7fc712ff1718 base::SleepForNanoseconds() 18:16:33.413 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x4024ec kudu::tserver::TabletServerMain() 18:16:33.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) *** Aborted at 1505931393 (unix time) try "date -d @1505931393" if you are using GNU date *** 18:16:33.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) PC: @ 0x7fadfeee1d4d nanosleep 18:16:33.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) *** SIGTERM (@0x3e800001479) received by PID 7497 (TID 0x7fae00f30880) from PID 5241; stack trace: *** 18:16:33.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fadfee53cb0 (unknown) 18:16:33.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fadfeee1d4d nanosleep 18:16:33.428 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fae00315670 kudu::Thread::StartThread() 18:16:33.429 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fadfcd7771e kudu::rpc::ServicePool::Init() 18:16:33.431 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fae008373cd kudu::RpcServer::RegisterService() 18:16:33.431 [DEBUG - New I/O worker #71] (Connection.java:666) [peer ed5a3ca82f6c4c88aeeca222d59ff40a] cleaning up while in state READY due to: connection disconnected 18:16:33.434 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fae0083a837 kudu::server::ServerBase::RegisterService() 18:16:33.436 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fae0083ee91 kudu::server::ServerBase::Start() 18:16:33.437 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fadfec1acd5 kudu::kserver::KuduServer::Start() 18:16:33.439 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x7fae00add220 kudu::tserver::TabletServer::Start() 18:16:33.440 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) @ 0x40247f kudu::tserver::TabletServerMain() 18:16:33.505 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:33.505 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:33.505228 7953 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:33.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:33.506253 7953 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:33.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:33.506278 7953 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:33.506 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:33.506287 7953 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:33.508 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.507508 7953 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:33.508 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:33.508 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:33.508 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:33.508 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:33.508 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64036 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.7953 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:33.509 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:33.510 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:33.510 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/logs 18:16:33.510 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 18:16:33.510 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 18:16:33.510 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:33.510 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:33.510 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type RELEASE 18:16:33.510 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:33.511 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 10042 18:16:33.516 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.516654 7953 minidump.cc:237] Setting minidump size limit to 20M 18:16:33.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.550240 7953 tablet_server_main.cc:79] Initializing tablet server... 18:16:33.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.550514 7953 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 688139 18:16:33.551 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.551887 7953 fs_manager.cc:324] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s 18:16:33.552 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.551936 7953 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:33.552 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.551966 7953 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:33.557 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.557591 7953 fs_manager.cc:336] Time spent opening block manager: real 0.005s user 0.000s sys 0.000s 18:16:33.558 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.558086 7953 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data 18:16:33.558 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" 18:16:33.558 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:33.558 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.558135 7953 fs_report.cc:347] Block manager report 18:16:33.558 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 18:16:33.558 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data/data 18:16:33.558 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:33.558 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:33.559 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:33.559 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:33.559 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:33.559 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:33.559 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:33.559 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:33.559 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:33.559 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:33.599 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.599414 7953 ts_tablet_manager.cc:284] Loading tablet metadata (0/2 complete) 18:16:33.599 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.599442 7953 ts_tablet_manager.cc:855] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Loading tablet metadata 18:16:33.600 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.600134 7953 ts_tablet_manager.cc:855] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Loading tablet metadata 18:16:33.601 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.600489 7953 ts_tablet_manager.cc:296] Loaded tablet metadata (2 live tablets) 18:16:33.601 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.601187 7953 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Registered tablet (data state: TABLET_DATA_READY) 18:16:33.602 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.601589 8005 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrapping tablet 18:16:33.603 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.601677 8005 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap starting. 18:16:33.603 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.601754 7953 ts_tablet_manager.cc:1028] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Registered tablet (data state: TABLET_DATA_READY) 18:16:33.603 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.602850 8005 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Log is configured to *not* fsync() on all Append() calls 18:16:33.603 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.603399 7953 tablet_server_main.cc:84] Starting tablet server... 18:16:33.618 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.617185 8005 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates 18:16:33.619 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.617422 8005 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap complete. 18:16:33.619 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.617514 8005 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.000s 18:16:33.619 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.618587 8005 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:33.619 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.618736 8005 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Initialized, Role: FOLLOWER 18:16:33.619 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.618768 8005 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:33.619 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.619719 8005 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s 18:16:33.619 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.619921 8005 ts_tablet_manager.cc:878] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrapping tablet 18:16:33.621 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.620115 8005 tablet_bootstrap.cc:432] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap starting. 18:16:33.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.622490 8005 tablet_bootstrap.cc:432] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 18:16:33.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.622668 8005 tablet_bootstrap.cc:432] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap complete. 18:16:33.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.622944 8005 ts_tablet_manager.cc:903] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s 18:16:33.623 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.623319 8005 raft_consensus.cc:286] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:33.623 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.623545 8005 raft_consensus.cc:575] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Initialized, Role: FOLLOWER 18:16:33.623 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.623735 8005 consensus_queue.cc:190] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:33.623 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.623910 8005 raft_consensus.cc:327] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately 18:16:33.624 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.624083 8005 raft_consensus.cc:411] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) 18:16:33.624 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.624275 8005 raft_consensus.cc:2455] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 2.042s (starting election) 18:16:33.624 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.624511 8005 raft_consensus.cc:2507] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Advancing to term 2 18:16:33.626 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.626207 8005 raft_consensus.cc:433] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:33.626 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.626443 8005 leader_election.cc:248] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. 18:16:33.641 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.641141 8005 ts_tablet_manager.cc:931] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent starting tablet: real 0.018s user 0.000s sys 0.004s 18:16:33.641 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.641222 8068 raft_consensus.cc:2455] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 1.504s (election complete) 18:16:33.641 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.641244 8068 raft_consensus.cc:2279] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 FOLLOWER]: Leader election won for term 2 18:16:33.662 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.660584 8068 raft_consensus.cc:541] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 LEADER]: Becoming Leader. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Running, Role: LEADER 18:16:33.662 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.660717 8068 consensus_queue.cc:169] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:33.665 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.665498 7953 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64036 18:16:33.666 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.665580 7953 webserver.cc:149] Starting webserver on 127.20.121.1:64037 18:16:33.666 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.665590 7953 webserver.cc:160] Document root disabled 18:16:33.666 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.665794 7953 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64037/ 18:16:33.667 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.667347 7953 tablet_server_main.cc:87] Tablet server successfully started. 18:16:33.667 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.667551 8140 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:33.667 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.667577 8140 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:33.667 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.667583 8140 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:33.706 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.705845 8138 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:33.706 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.705845 8134 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:33.706 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.705924 8134 heartbeater.cc:387] Registering TS with master... 18:16:33.706 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.705924 8138 heartbeater.cc:387] Registering TS with master... 18:16:33.706 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.706023 8134 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:33.706 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.706310 5543 ts_manager.cc:87] Re-registered known tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:33.710 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.706413 5543 catalog_manager.cc:2615] T ebc65b53aa524c72b3aa9390d0769cc3 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } } 18:16:33.710 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:33.709221 5543 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:42722 18:16:33.710 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:33.710058 5729 ts_manager.cc:87] Re-registered known tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:33.707 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:33.707397 5650 ts_manager.cc:87] Re-registered known tserver with Master: ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) 18:16:33.707 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.706991 8136 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:33.711 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.707008 8136 heartbeater.cc:387] Registering TS with master... 18:16:33.711 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.707041 8136 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:33.711 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:33.706023 8138 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:33.926 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:33.927 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:33.926789 8170 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:33.927 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:33.927780 8170 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:33.927 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:33.927806 8170 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:33.928 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:33.927815 8170 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:33.949 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.949247 8170 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:33.949 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:33.949 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:33.949 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:33.949 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64038 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.8170 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:33.950 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:33.951 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:33.951 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:33.951 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/logs 18:16:33.957 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 18:16:33.957 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 18:16:33.957 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:33.957 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:33.958 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type RELEASE 18:16:33.958 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:33.958 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 10042 18:16:33.958 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.949514 8170 minidump.cc:237] Setting minidump size limit to 20M 18:16:33.988 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.988593 8170 tablet_server_main.cc:79] Initializing tablet server... 18:16:33.988 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:33.988884 8170 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 688139 18:16:34.017 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.016614 8170 fs_manager.cc:324] Time spent opening directory manager: real 0.027s user 0.004s sys 0.000s 18:16:34.018 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.016705 8170 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:34.018 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.016757 8170 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:34.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.018463 8170 fs_manager.cc:336] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s 18:16:34.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.019008 8170 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data 18:16:34.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "769021b95fba49269f11c58d171f33a6" 18:16:34.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:34.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.019049 8170 fs_report.cc:347] Block manager report 18:16:34.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 18:16:34.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data/data 18:16:34.027 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:34.027 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:34.027 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:34.027 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:34.027 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:34.028 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:34.028 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:34.028 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:34.028 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:34.028 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:34.114 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.112815 8170 ts_tablet_manager.cc:284] Loading tablet metadata (0/1 complete) 18:16:34.114 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.112848 8170 ts_tablet_manager.cc:855] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Loading tablet metadata 18:16:34.114 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.113675 8170 ts_tablet_manager.cc:296] Loaded tablet metadata (1 live tablets) 18:16:34.114 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.114431 8170 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Registered tablet (data state: TABLET_DATA_READY) 18:16:34.140 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.140398 8228 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrapping tablet 18:16:34.141 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.141252 8228 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrap starting. 18:16:34.147 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.146824 8228 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Log is configured to *not* fsync() on all Append() calls 18:16:34.149 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.148504 8170 tablet_server_main.cc:84] Starting tablet server... 18:16:34.170 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.170907 8228 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 18:16:34.171 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.171452 8228 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Bootstrap complete. 18:16:34.171 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.171756 8228 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.000s 18:16:34.173 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.173416 8228 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:34.173 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.173729 8228 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769021b95fba49269f11c58d171f33a6, State: Initialized, Role: FOLLOWER 18:16:34.173 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.173914 8228 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:34.180 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:34.180887 8228 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Time spent starting tablet: real 0.009s user 0.000s sys 0.004s 18:16:34.229 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:34.230 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:34.229580 8227 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:34.230 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:34.230602 8227 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:34.231 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:34.230618 8227 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:34.231 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:34.230628 8227 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:34.231 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.231876 8227 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:34.232 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:34.232 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:34.232 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:34.232 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:34.232 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64040 18:16:34.232 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:34.232 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.8227 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:34.233 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/logs 18:16:34.234 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 18:16:34.234 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 18:16:34.234 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:34.234 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:34.234 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type RELEASE 18:16:34.234 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:34.234 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 10042 18:16:34.242 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.242051 8227 minidump.cc:237] Setting minidump size limit to 20M 18:16:34.292 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.292528 8227 tablet_server_main.cc:79] Initializing tablet server... 18:16:34.292 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.292841 8227 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 688639 18:16:34.294 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.294205 8227 fs_manager.cc:324] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s 18:16:34.294 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.294260 8227 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:34.294 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.294294 8227 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:34.308 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.308671 8227 fs_manager.cc:336] Time spent opening block manager: real 0.013s user 0.004s sys 0.000s 18:16:34.312 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.309255 8227 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data 18:16:34.312 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "3476168b44e2452ebba1aa8d51aab35c" 18:16:34.312 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:27 on jenkins-slave-c3oe" 18:16:34.312 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.309306 8227 fs_report.cc:347] Block manager report 18:16:34.312 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data/data 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:34.313 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:34.314 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:34.314 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:34.432 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.432898 8227 ts_tablet_manager.cc:284] Loading tablet metadata (0/1 complete) 18:16:34.433 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.433279 8227 ts_tablet_manager.cc:855] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Loading tablet metadata 18:16:34.434 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.434236 8227 ts_tablet_manager.cc:296] Loaded tablet metadata (1 live tablets) 18:16:34.435 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.435155 8227 ts_tablet_manager.cc:1028] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Registered tablet (data state: TABLET_DATA_READY) 18:16:34.452 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.452730 8278 ts_tablet_manager.cc:878] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrapping tablet 18:16:34.453 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.453233 8278 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrap starting. 18:16:34.454 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.454686 8278 log.cc:519] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Log is configured to *not* fsync() on all Append() calls 18:16:34.464 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.464591 8278 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates 18:16:34.464 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.464951 8227 tablet_server_main.cc:84] Starting tablet server... 18:16:34.465 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.465122 8278 tablet_bootstrap.cc:432] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Bootstrap complete. 18:16:34.465 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.465499 8278 ts_tablet_manager.cc:903] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.000s 18:16:34.466 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.466838 8278 raft_consensus.cc:286] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:34.467 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.467160 8278 raft_consensus.cc:575] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3476168b44e2452ebba1aa8d51aab35c, State: Initialized, Role: FOLLOWER 18:16:34.467 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.467389 8278 consensus_queue.cc:190] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:34.488 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:34.484673 8278 ts_tablet_manager.cc:931] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Time spent starting tablet: real 0.019s user 0.004s sys 0.000s 18:16:34.583 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:34.583586 5543 catalog_manager.cc:1634] Servicing DeleteTable request from {username='jenkins-slave'} at 127.0.0.1:38167: 18:16:34.592 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) table { table_name: "non-replicated" } 18:16:34.609 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:34.608774 5543 catalog_manager.cc:3552] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Sending DeleteTablet for 1 replicas of tablet ebc65b53aa524c72b3aa9390d0769cc3 18:16:34.609 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:34.608978 5543 catalog_manager.cc:3209] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet ebc65b53aa524c72b3aa9390d0769cc3 on ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) (Table deleted at 2017-09-20 18:16:34 UTC) 18:16:34.621 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621269 8049 tablet_service.cc:806] Processing DeleteTablet for tablet ebc65b53aa524c72b3aa9390d0769cc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2017-09-20 18:16:34 UTC) from {username='jenkins-slave'} at 127.20.121.1:44383 18:16:34.621 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621322 8049 tablet_replica.cc:257] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: stopping tablet replica 18:16:34.621 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621345 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op CompactRowSetsOp(ebc65b53aa524c72b3aa9390d0769cc3) 18:16:34.621 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621354 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op MinorDeltaCompactionOp(ebc65b53aa524c72b3aa9390d0769cc3) 18:16:34.621 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621361 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op MajorDeltaCompactionOp(ebc65b53aa524c72b3aa9390d0769cc3) 18:16:34.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621366 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op UndoDeltaBlockGCOp(ebc65b53aa524c72b3aa9390d0769cc3) 18:16:34.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621377 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op FlushMRSOp(ebc65b53aa524c72b3aa9390d0769cc3) 18:16:34.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621382 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op FlushDeltaMemStoresOp(ebc65b53aa524c72b3aa9390d0769cc3) 18:16:34.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621387 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op LogGCOp(ebc65b53aa524c72b3aa9390d0769cc3) 18:16:34.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621404 8049 raft_consensus.cc:1806] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 LEADER]: Raft consensus shutting down. 18:16:34.622 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.621440 8049 raft_consensus.cc:1833] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 FOLLOWER]: Raft consensus is shut down! 18:16:34.625 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3a29e776, flushNotification=Deferred@1041659115(state=PENDING, result=null, callback=, errback=)} 18:16:34.626 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.624094 8049 ts_tablet_manager.cc:1203] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Deleting tablet data with delete state TABLET_DATA_DELETED 18:16:34.626 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.625526 8049 ts_tablet_manager.cc:1216] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: tablet deleted: last-logged OpId: 2.4 18:16:34.627 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.625555 8049 log.cc:980] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Deleting WAL directory at /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data/wals/ebc65b53aa524c72b3aa9390d0769cc3 18:16:34.627 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.625735 8049 ts_tablet_manager.cc:1234] T ebc65b53aa524c72b3aa9390d0769cc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Deleting consensus metadata 18:16:34.627 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:34.626153 5523 catalog_manager.cc:3187] TS ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036): tablet ebc65b53aa524c72b3aa9390d0769cc3 (table non-replicated [id=a376925c53624b9d95de8b949fdf3869]) successfully deleted 18:16:34.630 [DEBUG - Time-limited test] (AsyncKuduClient.java:1727) Learned about tablet 5ceb1b36c63b4045be78db7318693bc3 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:34.630 [DEBUG - Time-limited test] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=5ceb1b36c63b4045be78db7318693bc3, ttl=299999}] 18:16:34.633 [DEBUG - Time-limited test] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=null, attempt=1, DeadlineTracker(timeout=30000, elapsed=4), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [2ms] Sub rpc: GetTableLocations received from server response OK, Deferred@2064969037(state=PENDING, result=null, callback=apply batch response, errback=apply batch error response))} after lookup 18:16:34.636 [DEBUG - Time-limited test] (Deferred.java:1330) callback=retry RPC@1061300083 returned Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083)), so the following Deferred is getting paused: Deferred@1252357562(state=PAUSED, result=Deferred@2064969037, callback=, errback=) 18:16:34.636 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@4719e129@1192878377 returned Deferred@456856066(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@904714153 after org.apache.kudu.client.AsyncKuduSession$1@4719e129@1192878377), errback=passthrough -> (continuation of Deferred@904714153 after org.apache.kudu.client.AsyncKuduSession$1@4719e129@1192878377)), so the following Deferred is getting paused: Deferred@904714153(state=PAUSED, result=Deferred@456856066, callback=, errback=) 18:16:34.651 [DEBUG - New I/O worker #72] (RemoteTablet.java:133) ed5a3ca82f6c4c88aeeca222d59ff40a was demoted as the leader for 5ceb1b36c63b4045be78db7318693bc3 18:16:34.670 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet 5ceb1b36c63b4045be78db7318693bc3 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:34.671 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=5ceb1b36c63b4045be78db7318693bc3, ttl=299999}] 18:16:34.672 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=5ceb1b36c63b4045be78db7318693bc3, attempt=3, DeadlineTracker(timeout=30000, elapsed=45), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [2ms] Sub rpc: GetTableLocations received from server response OK, [8ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [26ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [27ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [39ms] querying master, [39ms] Sub rpc: GetTableLocations sending RPC to server , [43ms] Sub rpc: GetTableLocations received from server response OK, Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083)))} after lookup 18:16:34.673 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1386872650 returned Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650)), so the following Deferred is getting paused: Deferred@2064019836(state=PAUSED, result=Deferred@2064969037, callback=, errback=) 18:16:34.675 [DEBUG - New I/O worker #72] (RemoteTablet.java:133) ed5a3ca82f6c4c88aeeca222d59ff40a was demoted as the leader for 5ceb1b36c63b4045be78db7318693bc3 18:16:34.708 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet 5ceb1b36c63b4045be78db7318693bc3 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:34.710 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=5ceb1b36c63b4045be78db7318693bc3, ttl=299999}] 18:16:34.710 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=5ceb1b36c63b4045be78db7318693bc3, attempt=5, DeadlineTracker(timeout=30000, elapsed=83), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [2ms] Sub rpc: GetTableLocations received from server response OK, [8ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [26ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [27ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [39ms] querying master, [39ms] Sub rpc: GetTableLocations sending RPC to server , [43ms] Sub rpc: GetTableLocations received from server response OK, [46ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [50ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [50ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [79ms] querying master, [79ms] Sub rpc: GetTableLocations sending RPC to server , [81ms] Sub rpc: GetTableLocations received from server response OK, Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650)))} after lookup 18:16:34.711 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:34.711625 8134 heartbeater.cc:406] Master 127.20.121.1:64030 was elected leader, sending a full tablet report... 18:16:34.712 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@987068514 returned Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514)), so the following Deferred is getting paused: Deferred@39887027(state=PAUSED, result=Deferred@2064969037, callback=, errback=) 18:16:34.718 [DEBUG - New I/O worker #72] (RemoteTablet.java:133) ed5a3ca82f6c4c88aeeca222d59ff40a was demoted as the leader for 5ceb1b36c63b4045be78db7318693bc3 18:16:34.768 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet 5ceb1b36c63b4045be78db7318693bc3 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:34.769 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=5ceb1b36c63b4045be78db7318693bc3, ttl=299999}] 18:16:34.771 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=5ceb1b36c63b4045be78db7318693bc3, attempt=7, DeadlineTracker(timeout=30000, elapsed=144), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [2ms] Sub rpc: GetTableLocations received from server response OK, [8ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [26ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [27ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [39ms] querying master, [39ms] Sub rpc: GetTableLocations sending RPC to server , [43ms] Sub rpc: GetTableLocations received from server response OK, [46ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [50ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [50ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [79ms] querying master, [79ms] Sub rpc: GetTableLocations sending RPC to server , [81ms] Sub rpc: GetTableLocations received from server response OK, [85ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [92ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [92ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [138ms] querying master, [138ms] Sub rpc: GetTableLocations sending RPC to server , [141ms] Sub rpc: GetTableLocations received from server response OK, Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514)))} after lookup 18:16:34.774 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@523131930 returned Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930)), so the following Deferred is getting paused: Deferred@1475035922(state=PAUSED, result=Deferred@2064969037, callback=, errback=) 18:16:34.777 [DEBUG - New I/O worker #72] (RemoteTablet.java:133) ed5a3ca82f6c4c88aeeca222d59ff40a was demoted as the leader for 5ceb1b36c63b4045be78db7318693bc3 18:16:34.950 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet 5ceb1b36c63b4045be78db7318693bc3 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:34.950 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=5ceb1b36c63b4045be78db7318693bc3, ttl=299999}] 18:16:34.963 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=5ceb1b36c63b4045be78db7318693bc3, attempt=9, DeadlineTracker(timeout=30000, elapsed=324), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [2ms] Sub rpc: GetTableLocations received from server response OK, [8ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [26ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [27ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [39ms] querying master, [39ms] Sub rpc: GetTableLocations sending RPC to server , [43ms] Sub rpc: GetTableLocations received from server response OK, [46ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [50ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [50ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [79ms] querying master, [79ms] Sub rpc: GetTableLocations sending RPC to server , [81ms] Sub rpc: GetTableLocations received from server response OK, [85ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [92ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [92ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [138ms] querying master, [138ms] Sub rpc: GetTableLocations sending RPC to server , [141ms] Sub rpc: GetTableLocations received from server response OK, [147ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [151ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [151ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [319ms] querying master, [319ms] Sub rpc: GetTableLocations sending RPC to server , [322ms] Sub rpc: GetTableLocations received from server response OK, Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930)))} after lookup 18:16:34.964 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@1181497317 returned Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317)), so the following Deferred is getting paused: Deferred@1091465891(state=PAUSED, result=Deferred@2064969037, callback=, errback=) 18:16:34.967 [DEBUG - New I/O worker #72] (RemoteTablet.java:133) ed5a3ca82f6c4c88aeeca222d59ff40a was demoted as the leader for 5ceb1b36c63b4045be78db7318693bc3 18:16:35.189 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet 5ceb1b36c63b4045be78db7318693bc3 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:35.190 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=5ceb1b36c63b4045be78db7318693bc3, ttl=299999}] 18:16:35.191 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=5ceb1b36c63b4045be78db7318693bc3, attempt=11, DeadlineTracker(timeout=30000, elapsed=563), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [2ms] Sub rpc: GetTableLocations received from server response OK, [8ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [26ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [27ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [39ms] querying master, [39ms] Sub rpc: GetTableLocations sending RPC to server , [43ms] Sub rpc: GetTableLocations received from server response OK, [46ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [50ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [50ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [79ms] querying master, [79ms] Sub rpc: GetTableLocations sending RPC to server , [81ms] Sub rpc: GetTableLocations received from server response OK, [85ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [92ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [92ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [138ms] querying master, [138ms] Sub rpc: GetTableLocations sending RPC to server , [141ms] Sub rpc: GetTableLocations received from server response OK, [147ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [151ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [151ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [319ms] querying master, [319ms] Sub rpc: GetTableLocations sending RPC to server , [322ms] Sub rpc: GetTableLocations received from server response OK, [337ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [341ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [341ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [559ms] querying master, [559ms] Sub rpc: GetTableLocations sending RPC to server , [562ms] Sub rpc: GetTableLocations received from server response OK, Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317)))} after lookup 18:16:35.197 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@749545492 returned Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317) -> (continuation of Deferred@559095104 after retry RPC@749545492), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317) -> (continuation of Deferred@559095104 after retry RPC@749545492)), so the following Deferred is getting paused: Deferred@559095104(state=PAUSED, result=Deferred@2064969037, callback=, errback=) 18:16:35.201 [DEBUG - New I/O worker #72] (RemoteTablet.java:133) ed5a3ca82f6c4c88aeeca222d59ff40a was demoted as the leader for 5ceb1b36c63b4045be78db7318693bc3 18:16:35.335 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.335116 8170 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64038 18:16:35.335 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.335654 8170 webserver.cc:149] Starting webserver on 127.20.121.1:64039 18:16:35.335 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.335813 8170 webserver.cc:160] Document root disabled 18:16:35.336 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.336211 8170 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64039/ 18:16:35.387 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.387624 8461 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:35.388 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.387691 8461 heartbeater.cc:387] Registering TS with master... 18:16:35.388 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.387786 8461 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:35.388 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:35.388662 5543 ts_manager.cc:87] Re-registered known tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:35.389 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:35.389417 5543 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:60967 18:16:35.395 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.395782 8464 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:35.396 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.396075 8464 heartbeater.cc:387] Registering TS with master... 18:16:35.396 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.396275 8464 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:35.396 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:35.396577 5650 ts_manager.cc:87] Re-registered known tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:35.424 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.424270 8470 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:35.424 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.424320 8470 heartbeater.cc:387] Registering TS with master... 18:16:35.424 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.424355 8470 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:35.424 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:35.424685 5729 ts_manager.cc:87] Re-registered known tserver with Master: 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) 18:16:35.432 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.432663 8478 raft_consensus.cc:411] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 18:16:35.433 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.433027 8478 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 2.183s (starting election) 18:16:35.433 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.433323 8478 raft_consensus.cc:433] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:35.433 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.433816 8478 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 pre-election: Requesting pre-vote from peer 769021b95fba49269f11c58d171f33a6 18:16:35.434 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.434458 8478 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 pre-election: Requesting pre-vote from peer 3476168b44e2452ebba1aa8d51aab35c 18:16:35.440 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.440667 8476 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:35.440 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.440666 8170 tablet_server_main.cc:87] Tablet server successfully started. 18:16:35.441 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.441117 8476 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:35.441 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.441299 8476 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:35.456 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:35.456804 7988 leader_election.cc:277] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3476168b44e2452ebba1aa8d51aab35c: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64040: connect: Connection refused (error 111) 18:16:35.461 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.461634 8355 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "5ceb1b36c63b4045be78db7318693bc3" candidate_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "769021b95fba49269f11c58d171f33a6" is_pre_election: true 18:16:35.461 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.461716 8355 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Snoozing failure detection for 2.177s (vote granted) 18:16:35.461 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.461738 8355 raft_consensus.cc:2009] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed5a3ca82f6c4c88aeeca222d59ff40a in term 1. 18:16:35.462 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.461968 7993 leader_election.cc:353] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 pre-election: Vote granted by peer 769021b95fba49269f11c58d171f33a6 18:16:35.462 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.461990 7993 leader_election.cc:248] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. 18:16:35.462 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.462293 8478 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 2.053s (election complete) 18:16:35.462 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.462317 8478 raft_consensus.cc:2279] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Leader pre-election won for term 2 18:16:35.462 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.462326 8478 raft_consensus.cc:411] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 18:16:35.462 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.462333 8478 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 2.075s (starting election) 18:16:35.462 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.462338 8478 raft_consensus.cc:2507] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Advancing to term 2 18:16:35.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.463140 8478 raft_consensus.cc:433] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:35.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.463284 8478 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 election: Requesting vote from peer 769021b95fba49269f11c58d171f33a6 18:16:35.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.463492 8478 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 election: Requesting vote from peer 3476168b44e2452ebba1aa8d51aab35c 18:16:35.463 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:35.463887 7988 leader_election.cc:277] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3476168b44e2452ebba1aa8d51aab35c: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64040: connect: Connection refused (error 111) 18:16:35.464 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.463567 8355 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "5ceb1b36c63b4045be78db7318693bc3" candidate_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "769021b95fba49269f11c58d171f33a6" 18:16:35.464 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.463593 8355 raft_consensus.cc:2507] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Advancing to term 2 18:16:35.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.464485 7993 leader_election.cc:353] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 election: Vote granted by peer 769021b95fba49269f11c58d171f33a6 18:16:35.464 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.464501 7993 leader_election.cc:248] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. 18:16:35.464 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.463629 8355 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Snoozing failure detection for 1.698s (vote granted) 18:16:35.464 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:35.464352 8355 raft_consensus.cc:2009] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed5a3ca82f6c4c88aeeca222d59ff40a in term 2. 18:16:35.465 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.464979 8478 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 2.089s (election complete) 18:16:35.465 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.465102 8478 raft_consensus.cc:2279] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 FOLLOWER]: Leader election won for term 2 18:16:35.497 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.497160 8478 raft_consensus.cc:541] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 LEADER]: Becoming Leader. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Running, Role: LEADER 18:16:35.497 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:35.497675 8478 consensus_queue.cc:169] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:35.526 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:35.525784 5543 catalog_manager.cc:2615] T 5ceb1b36c63b4045be78db7318693bc3 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } 18:16:36.065 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:36.064976 8355 raft_consensus.cc:963] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 2 FOLLOWER]: Refusing update from remote peer ed5a3ca82f6c4c88aeeca222d59ff40a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch) 18:16:36.065 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:36.065572 8574 consensus_queue.cc:741] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [LEADER]: Connected to new peer: Peer: 769021b95fba49269f11c58d171f33a6, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:36.077 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.077481 8577 raft_consensus.cc:411] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 18:16:36.077 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.077837 8577 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Snoozing failure detection for 2.239s (starting election) 18:16:36.078 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.078049 8577 raft_consensus.cc:433] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:36.078 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.078462 8577 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [CANDIDATE]: Term 2 pre-election: Requesting pre-vote from peer 769021b95fba49269f11c58d171f33a6 18:16:36.078 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:36.078480 8461 heartbeater.cc:406] Master 127.20.121.1:64030 was elected leader, sending a full tablet report... 18:16:36.079 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.079094 8577 leader_election.cc:221] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [CANDIDATE]: Term 2 pre-election: Requesting pre-vote from peer ed5a3ca82f6c4c88aeeca222d59ff40a 18:16:36.080 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.080112 8227 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64040 18:16:36.080 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.080207 8227 webserver.cc:149] Starting webserver on 127.20.121.1:64041 18:16:36.080 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.080219 8227 webserver.cc:160] Document root disabled 18:16:36.080 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.080443 8227 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64041/ 18:16:36.081 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.081286 8227 tablet_server_main.cc:87] Tablet server successfully started. 18:16:36.081 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.081385 8594 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:36.081 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.081637 8594 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:36.081 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.081773 8594 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:36.119 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:36.119292 8355 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "5ceb1b36c63b4045be78db7318693bc3" candidate_uuid: "3476168b44e2452ebba1aa8d51aab35c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769021b95fba49269f11c58d171f33a6" is_pre_election: true 18:16:36.119 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:36.119349 8355 raft_consensus.cc:1970] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3476168b44e2452ebba1aa8d51aab35c for term 2 because replica is either leader or believes a valid leader to be alive. 18:16:36.120 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.120041 8268 leader_election.cc:367] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 769021b95fba49269f11c58d171f33a6. Message: Invalid argument: T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3476168b44e2452ebba1aa8d51aab35c for term 2 because replica is either leader or believes a valid leader to be alive. 18:16:36.133 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:36.132892 8086 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "5ceb1b36c63b4045be78db7318693bc3" candidate_uuid: "3476168b44e2452ebba1aa8d51aab35c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" is_pre_election: true 18:16:36.133 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:36.132957 8086 raft_consensus.cc:1970] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 LEADER]: Leader pre-election vote request: Denying vote to candidate 3476168b44e2452ebba1aa8d51aab35c for term 2 because replica is either leader or believes a valid leader to be alive. 18:16:36.134 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.133136 8263 leader_election.cc:367] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [CANDIDATE]: Term 2 pre-election: Vote denied by peer ed5a3ca82f6c4c88aeeca222d59ff40a. Message: Invalid argument: T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 LEADER]: Leader pre-election vote request: Denying vote to candidate 3476168b44e2452ebba1aa8d51aab35c for term 2 because replica is either leader or believes a valid leader to be alive. 18:16:36.134 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.133165 8263 leader_election.cc:248] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. 18:16:36.134 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.133293 8577 raft_consensus.cc:2455] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Snoozing failure detection for 1.777s (election complete) 18:16:36.134 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.133312 8577 raft_consensus.cc:2507] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Advancing to term 2 18:16:36.134 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.134402 8577 raft_consensus.cc:2215] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority 18:16:36.140 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.140395 8591 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:36.140 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.140491 8591 heartbeater.cc:387] Registering TS with master... 18:16:36.140 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.140599 8591 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:36.141 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:36.141419 5650 ts_manager.cc:87] Re-registered known tserver with Master: 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040) 18:16:36.142 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:36.142671 5729 ts_manager.cc:87] Re-registered known tserver with Master: 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040) 18:16:36.142 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.142379 8593 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:36.143 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.142400 8593 heartbeater.cc:387] Registering TS with master... 18:16:36.143 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.142437 8593 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:36.143 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.142658 8590 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:36.143 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.142678 8590 heartbeater.cc:387] Registering TS with master... 18:16:36.143 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.142730 8590 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:36.143 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:36.142922 5543 ts_manager.cc:87] Re-registered known tserver with Master: 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040) 18:16:36.143 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:36.143662 5543 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:59254 18:16:36.143 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.143761 8454 raft_consensus.cc:963] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 2 FOLLOWER]: Refusing update from remote peer ed5a3ca82f6c4c88aeeca222d59ff40a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch) 18:16:36.144 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:36.144008 8574 consensus_queue.cc:741] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [LEADER]: Connected to new peer: Peer: 3476168b44e2452ebba1aa8d51aab35c, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:36.144 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:36.144467 8590 heartbeater.cc:406] Master 127.20.121.1:64030 was elected leader, sending a full tablet report... 18:16:36.990 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:1727) Learned about tablet 5ceb1b36c63b4045be78db7318693bc3 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:36.990 [DEBUG - New I/O worker #69] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=5ceb1b36c63b4045be78db7318693bc3, ttl=299999}] 18:16:36.992 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:916) Retrying sending RPC Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=5ceb1b36c63b4045be78db7318693bc3, attempt=13, DeadlineTracker(timeout=30000, elapsed=2364), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [2ms] Sub rpc: GetTableLocations received from server response OK, [8ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [26ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [27ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [39ms] querying master, [39ms] Sub rpc: GetTableLocations sending RPC to server , [43ms] Sub rpc: GetTableLocations received from server response OK, [46ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [50ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [50ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [79ms] querying master, [79ms] Sub rpc: GetTableLocations sending RPC to server , [81ms] Sub rpc: GetTableLocations received from server response OK, [85ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [92ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [92ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [138ms] querying master, [138ms] Sub rpc: GetTableLocations sending RPC to server , [141ms] Sub rpc: GetTableLocations received from server response OK, [147ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [151ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [151ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [319ms] querying master, [319ms] Sub rpc: GetTableLocations sending RPC to server , [322ms] Sub rpc: GetTableLocations received from server response OK, [337ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [341ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [341ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [559ms] querying master, [559ms] Sub rpc: GetTableLocations sending RPC to server , [562ms] Sub rpc: GetTableLocations received from server response OK, [565ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [577ms] delaying RPC due to Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [578ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Illegal state: Replica ed5a3ca82f6c4c88aeeca222d59ff40a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 1 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } (error 0), [2359ms] querying master, [2359ms] Sub rpc: GetTableLocations sending RPC to server , [2361ms] Sub rpc: GetTableLocations received from server response OK, Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317) -> (continuation of Deferred@559095104 after retry RPC@749545492), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317) -> (continuation of Deferred@559095104 after retry RPC@749545492)))} after lookup 18:16:36.995 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=retry RPC@103269776 returned Deferred@2064969037(state=PENDING, result=null, callback=apply batch response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317) -> (continuation of Deferred@559095104 after retry RPC@749545492) -> (continuation of Deferred@873346205 after retry RPC@103269776), errback=apply batch error response -> (continuation of Deferred@1252357562 after retry RPC@1061300083) -> (continuation of Deferred@2064019836 after retry RPC@1386872650) -> (continuation of Deferred@39887027 after retry RPC@987068514) -> (continuation of Deferred@1475035922 after retry RPC@523131930) -> (continuation of Deferred@1091465891 after retry RPC@1181497317) -> (continuation of Deferred@559095104 after retry RPC@749545492) -> (continuation of Deferred@873346205 after retry RPC@103269776)), so the following Deferred is getting paused: Deferred@873346205(state=PAUSED, result=Deferred@2064969037, callback=, errback=) 18:16:37.049 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 1 rows, more=false) 18:16:37.104 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:37.106 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 18:16:37.111 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 18:16:37.114 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 18:16:37.114 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=null, flushNotification=Deferred@1418030091(state=PENDING, result=null, callback=, errback=)} 18:16:37.115 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@5c1dcf1b@1545457435 returned Deferred@527789464(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1041659115 after org.apache.kudu.client.AsyncKuduSession$1@5c1dcf1b@1545457435), errback=passthrough -> (continuation of Deferred@1041659115 after org.apache.kudu.client.AsyncKuduSession$1@5c1dcf1b@1545457435)), so the following Deferred is getting paused: Deferred@1041659115(state=PAUSED, result=Deferred@527789464, callback=, errback=) 18:16:37.122 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:37.177 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 18:16:37.179 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4cf7b040, flushNotification=Deferred@871196897(state=PENDING, result=null, callback=, errback=)} 18:16:37.193 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:38.205 [DEBUG - Hashed wheel timer #2] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3c499791, flushNotification=Deferred@848199272(state=PENDING, result=null, callback=, errback=)} 18:16:38.269 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 11 rows, more=false) 18:16:38.280 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 31 rows, more=false) 18:16:38.301 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 18:16:38.307 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 18:16:38.307 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@20581520(state=PENDING, result=null, callback=, errback=)} 18:16:38.309 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@3517b882@890747010 returned Deferred@1150516176(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@848199272 after org.apache.kudu.client.AsyncKuduSession$1@3517b882@890747010), errback=passthrough -> (continuation of Deferred@848199272 after org.apache.kudu.client.AsyncKuduSession$1@3517b882@890747010)), so the following Deferred is getting paused: Deferred@848199272(state=PAUSED, result=Deferred@1150516176, callback=, errback=) 18:16:38.336 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:38.345 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:38.349 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@484551107(state=PENDING, result=null, callback=, errback=)} 18:16:38.354 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@4d6e7843@1299085379 returned Deferred@1161108164(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@20581520 after org.apache.kudu.client.AsyncKuduSession$1@4d6e7843@1299085379), errback=passthrough -> (continuation of Deferred@20581520 after org.apache.kudu.client.AsyncKuduSession$1@4d6e7843@1299085379)), so the following Deferred is getting paused: Deferred@20581520(state=PAUSED, result=Deferred@1161108164, callback=, errback=) 18:16:38.362 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:38.443 [DEBUG - New I/O worker #72] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:38.446 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1a27a449, flushNotification=Deferred@194623871(state=PENDING, result=null, callback=, errback=)} 18:16:38.453 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@358b742f, flushNotification=Deferred@1485159264(state=PENDING, result=null, callback=, errback=)} 18:16:38.489 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.489122 5543 catalog_manager.cc:1634] Servicing DeleteTable request from {username='jenkins-slave'} at 127.0.0.1:38167: 18:16:38.489 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) table { table_name: "org.apache.kudu.client.TestAsyncKuduSession-1505931385592" } 18:16:38.549 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.548820 5543 catalog_manager.cc:3552] T 00000000000000000000000000000000 P cc55785a26934cc4ab3029ccde44c4dd: Sending DeleteTablet for 3 replicas of tablet 5ceb1b36c63b4045be78db7318693bc3 18:16:38.549 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.549036 5543 catalog_manager.cc:3209] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 5ceb1b36c63b4045be78db7318693bc3 on 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038) (Table deleted at 2017-09-20 18:16:38 UTC) 18:16:38.549 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.549082 5543 catalog_manager.cc:3209] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 5ceb1b36c63b4045be78db7318693bc3 on ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036) (Table deleted at 2017-09-20 18:16:38 UTC) 18:16:38.549 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.549211 5543 catalog_manager.cc:3209] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 5ceb1b36c63b4045be78db7318693bc3 on 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040) (Table deleted at 2017-09-20 18:16:38 UTC) 18:16:38.549 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549329 8049 tablet_service.cc:806] Processing DeleteTablet for tablet 5ceb1b36c63b4045be78db7318693bc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2017-09-20 18:16:38 UTC) from {username='jenkins-slave'} at 127.20.121.1:44383 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549365 8049 tablet_replica.cc:257] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: stopping tablet replica 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549377 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op CompactRowSetsOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549384 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op MinorDeltaCompactionOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549388 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op MajorDeltaCompactionOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549392 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op UndoDeltaBlockGCOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549399 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op FlushMRSOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549404 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op FlushDeltaMemStoresOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549412 8049 maintenance_manager.cc:228] P ed5a3ca82f6c4c88aeeca222d59ff40a: Unregistered op LogGCOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549432 8049 raft_consensus.cc:1806] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 LEADER]: Raft consensus shutting down. 18:16:38.550 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549450 8049 consensus_peers.cc:433] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a -> Peer 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040): Closing peer: 3476168b44e2452ebba1aa8d51aab35c 18:16:38.551 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549460 8049 consensus_peers.cc:433] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a -> Peer 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038): Closing peer: 769021b95fba49269f11c58d171f33a6 18:16:38.551 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549545 8049 raft_consensus.cc:1833] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a [term 2 FOLLOWER]: Raft consensus is shut down! 18:16:38.551 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.549931 8049 ts_tablet_manager.cc:1203] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Deleting tablet data with delete state TABLET_DATA_DELETED 18:16:38.550 [WARN - Time-limited test] (RpcProxy.java:125) [peer ed5a3ca82f6c4c88aeeca222d59ff40a] sending RPC with no timeout KuduRpc(method=ListTablets, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=0), Traces: [0ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, Deferred@1970602029(state=PENDING, result=null, callback=, errback=)) 18:16:38.551 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.551890 5523 catalog_manager.cc:3187] TS ed5a3ca82f6c4c88aeeca222d59ff40a (127.20.121.1:64036): tablet 5ceb1b36c63b4045be78db7318693bc3 (table org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=0c7ce07eeea84d93b9986bafd95c74d3]) successfully deleted 18:16:38.552 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.551337 8049 ts_tablet_manager.cc:1216] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: tablet deleted: last-logged OpId: 2.32 18:16:38.552 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.551367 8049 log.cc:980] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Deleting WAL directory at /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931387008/data/wals/5ceb1b36c63b4045be78db7318693bc3 18:16:38.552 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.551542 8049 ts_tablet_manager.cc:1234] T 5ceb1b36c63b4045be78db7318693bc3 P ed5a3ca82f6c4c88aeeca222d59ff40a: Deleting consensus metadata 18:16:38.561 [INFO - New I/O worker #72] (AsyncKuduClient.java:1582) Removing server ed5a3ca82f6c4c88aeeca222d59ff40a from this tablet's cache 5ceb1b36c63b4045be78db7318693bc3 18:16:38.566 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566619 8311 tablet_service.cc:806] Processing DeleteTablet for tablet 5ceb1b36c63b4045be78db7318693bc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2017-09-20 18:16:38 UTC) from {username='jenkins-slave'} at 127.20.121.1:39035 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566673 8311 tablet_replica.cc:257] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: stopping tablet replica 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566695 8311 maintenance_manager.cc:228] P 769021b95fba49269f11c58d171f33a6: Unregistered op CompactRowSetsOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566704 8311 maintenance_manager.cc:228] P 769021b95fba49269f11c58d171f33a6: Unregistered op MinorDeltaCompactionOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566710 8311 maintenance_manager.cc:228] P 769021b95fba49269f11c58d171f33a6: Unregistered op MajorDeltaCompactionOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566715 8311 maintenance_manager.cc:228] P 769021b95fba49269f11c58d171f33a6: Unregistered op UndoDeltaBlockGCOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566726 8311 maintenance_manager.cc:228] P 769021b95fba49269f11c58d171f33a6: Unregistered op FlushMRSOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566731 8311 maintenance_manager.cc:228] P 769021b95fba49269f11c58d171f33a6: Unregistered op FlushDeltaMemStoresOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566735 8311 maintenance_manager.cc:228] P 769021b95fba49269f11c58d171f33a6: Unregistered op LogGCOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566751 8311 raft_consensus.cc:1806] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 2 FOLLOWER]: Raft consensus shutting down. 18:16:38.567 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.566787 8311 raft_consensus.cc:1833] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6 [term 2 FOLLOWER]: Raft consensus is shut down! 18:16:38.569 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:950) Notify RPC KuduRpc(method=Write, tablet=5ceb1b36c63b4045be78db7318693bc3, attempt=2, DeadlineTracker(timeout=30000, elapsed=9), Traces: [0ms] sending RPC to server ed5a3ca82f6c4c88aeeca222d59ff40a, [2ms] delaying RPC due to Not found: Tablet not found: 5ceb1b36c63b4045be78db7318693bc3 (error 0), [2ms] received from server ed5a3ca82f6c4c88aeeca222d59ff40a response Not found: Tablet not found: 5ceb1b36c63b4045be78db7318693bc3 (error 0), [5ms] querying master, [5ms] Sub rpc: GetTableLocations sending RPC to server , [9ms] Sub rpc: GetTableLocations received from server response Not found: The table was deleted: Table deleted at 2017-09-20 18:16:38 UTC (error 0), Deferred@1898334080(state=PENDING, result=null, callback=passthrough -> wakeup thread Time-limited test, errback=org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@48a6edf9 -> wakeup thread Time-limited test)) after lookup exception org.apache.kudu.client.NonRecoverableException: The table was deleted: Table deleted at 2017-09-20 18:16:38 UTC at org.apache.kudu.client.RpcProxy.dispatchMasterError(RpcProxy.java:360) at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:253) at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:60) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:132) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:128) at org.apache.kudu.client.Connection.messageReceived(Connection.java:375) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.Connection.handleUpstream(Connection.java:239) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.handler.timeout.ReadTimeoutHandler.messageReceived(ReadTimeoutHandler.java:184) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 18:16:38.570 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.568189 8311 ts_tablet_manager.cc:1203] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Deleting tablet data with delete state TABLET_DATA_DELETED 18:16:38.570 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.569586 8311 ts_tablet_manager.cc:1216] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: tablet deleted: last-logged OpId: 2.32 18:16:38.570 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.569613 8311 log.cc:980] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Deleting WAL directory at /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931387008/data/wals/5ceb1b36c63b4045be78db7318693bc3 18:16:38.570 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.569777 8311 ts_tablet_manager.cc:1234] T 5ceb1b36c63b4045be78db7318693bc3 P 769021b95fba49269f11c58d171f33a6: Deleting consensus metadata 18:16:38.570 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.570212 5525 catalog_manager.cc:3187] TS 769021b95fba49269f11c58d171f33a6 (127.20.121.1:64038): tablet 5ceb1b36c63b4045be78db7318693bc3 (table org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=0c7ce07eeea84d93b9986bafd95c74d3]) successfully deleted 18:16:38.570 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569794 8403 tablet_service.cc:806] Processing DeleteTablet for tablet 5ceb1b36c63b4045be78db7318693bc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2017-09-20 18:16:38 UTC) from {username='jenkins-slave'} at 127.20.121.1:37428 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569838 8403 tablet_replica.cc:257] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: stopping tablet replica 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569856 8403 maintenance_manager.cc:228] P 3476168b44e2452ebba1aa8d51aab35c: Unregistered op CompactRowSetsOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569864 8403 maintenance_manager.cc:228] P 3476168b44e2452ebba1aa8d51aab35c: Unregistered op MinorDeltaCompactionOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569870 8403 maintenance_manager.cc:228] P 3476168b44e2452ebba1aa8d51aab35c: Unregistered op MajorDeltaCompactionOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569875 8403 maintenance_manager.cc:228] P 3476168b44e2452ebba1aa8d51aab35c: Unregistered op UndoDeltaBlockGCOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569885 8403 maintenance_manager.cc:228] P 3476168b44e2452ebba1aa8d51aab35c: Unregistered op FlushMRSOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569890 8403 maintenance_manager.cc:228] P 3476168b44e2452ebba1aa8d51aab35c: Unregistered op FlushDeltaMemStoresOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569895 8403 maintenance_manager.cc:228] P 3476168b44e2452ebba1aa8d51aab35c: Unregistered op LogGCOp(5ceb1b36c63b4045be78db7318693bc3) 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569910 8403 raft_consensus.cc:1806] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 2 FOLLOWER]: Raft consensus shutting down. 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.569960 8403 raft_consensus.cc:1833] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c [term 2 FOLLOWER]: Raft consensus is shut down! 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.570430 8403 ts_tablet_manager.cc:1203] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Deleting tablet data with delete state TABLET_DATA_DELETED 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.571702 8403 ts_tablet_manager.cc:1216] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: tablet deleted: last-logged OpId: 2.32 18:16:38.571 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.571725 8403 log.cc:980] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Deleting WAL directory at /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931387008/data/wals/5ceb1b36c63b4045be78db7318693bc3 18:16:38.572 [INFO - Time-limited test] (BaseKuduTest.java:131) Creating table: org.apache.kudu.client.TestAsyncKuduSession-1505931385592 18:16:38.572 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.572265 5522 catalog_manager.cc:3187] TS 3476168b44e2452ebba1aa8d51aab35c (127.20.121.1:64040): tablet 5ceb1b36c63b4045be78db7318693bc3 (table org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=0c7ce07eeea84d93b9986bafd95c74d3]) successfully deleted 18:16:38.572 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.571889 8403 ts_tablet_manager.cc:1234] T 5ceb1b36c63b4045be78db7318693bc3 P 3476168b44e2452ebba1aa8d51aab35c: Deleting consensus metadata 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.572999 5543 catalog_manager.cc:1312] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:38167: 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "org.apache.kudu.client.TestAsyncKuduSession-1505931385592" 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) schema { 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "key" 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: true 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column1_i" 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:38.573 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column2_i" 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: INT32 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column3_s" 18:16:38.574 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: STRING 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: true 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) compression: LZ4 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 4096 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "column4_b" 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) type: BOOL 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_key: false 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) is_nullable: false 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.575 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) partition_schema { 18:16:38.576 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) range_schema { 18:16:38.576 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) columns { 18:16:38.576 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) name: "key" 18:16:38.576 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.576 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.576 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) } 18:16:38.575 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@35fad26b@905630315 returned Deferred@1990433043(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@9156b1b -> (continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$1@35fad26b@905630315), errback=passthrough -> (continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$1@35fad26b@905630315)), so the following Deferred is getting paused: Deferred@1410126955(state=PAUSED, result=Deferred@1990433043, callback=org.apache.kudu.client.AsyncKuduClient$2@37063d0b -> wakeup thread Time-limited test, errback=passthrough -> wakeup thread Time-limited test) 18:16:38.577 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.575937 8311 tablet_service.cc:765] Processing CreateTablet for tablet 18c3adcc54d34f609ea53c815477482d (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=3d38c6a2a47347f8b386884c52928172]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:38.585 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.577059 8311 ts_tablet_manager.cc:1028] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Registered tablet (data state: TABLET_DATA_READY) 18:16:38.576 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.575880 8049 tablet_service.cc:765] Processing CreateTablet for tablet 18c3adcc54d34f609ea53c815477482d (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=3d38c6a2a47347f8b386884c52928172]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:38.585 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.577771 8049 ts_tablet_manager.cc:1028] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: Registered tablet (data state: TABLET_DATA_READY) 18:16:38.576 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.575806 8403 tablet_service.cc:765] Processing CreateTablet for tablet 18c3adcc54d34f609ea53c815477482d (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=3d38c6a2a47347f8b386884c52928172]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:38.586 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.577013 8403 ts_tablet_manager.cc:1028] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: Registered tablet (data state: TABLET_DATA_READY) 18:16:38.587 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:571) Opened table 3d38c6a2a47347f8b386884c52928172 18:16:38.587 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723 returned Deferred@1569149433(state=PENDING, result=null, callback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723), errback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723)), so the following Deferred is getting paused: Deferred@1410126955(state=PAUSED, result=Deferred@1569149433, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 18:16:38.593 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.592547 9044 ts_tablet_manager.cc:878] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrapping tablet 18:16:38.593 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.592612 9044 tablet_bootstrap.cc:432] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: Bootstrap starting. 18:16:38.593 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.592984 9044 tablet_bootstrap.cc:567] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: No blocks or log segments found. Creating new log. 18:16:38.593 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.593017 9042 ts_tablet_manager.cc:878] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Bootstrapping tablet 18:16:38.593 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.593085 9042 tablet_bootstrap.cc:432] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Bootstrap starting. 18:16:38.593 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.593406 9042 tablet_bootstrap.cc:567] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: No blocks or log segments found. Creating new log. 18:16:38.598 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.597723 9042 tablet_bootstrap.cc:432] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: No bootstrap required, opened a new log 18:16:38.598 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.597771 9042 ts_tablet_manager.cc:903] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s 18:16:38.598 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.597992 9042 raft_consensus.cc:286] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:38.598 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.598004 9042 raft_consensus.cc:312] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:38.598 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.598033 9042 raft_consensus.cc:575] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769021b95fba49269f11c58d171f33a6, State: Initialized, Role: FOLLOWER 18:16:38.598 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.598049 9042 consensus_queue.cc:190] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:38.606 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089 returned Deferred@1569149433(state=PENDING, result=null, callback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089), errback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089)), so the following Deferred is getting paused: Deferred@1299548411(state=PAUSED, result=Deferred@1569149433, callback=, errback=) 18:16:38.608 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.608479 9041 ts_tablet_manager.cc:878] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: Bootstrapping tablet 18:16:38.608 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.608757 9041 tablet_bootstrap.cc:432] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: Bootstrap starting. 18:16:38.609 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.609293 9041 tablet_bootstrap.cc:567] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: No blocks or log segments found. Creating new log. 18:16:38.610 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.610026 9042 ts_tablet_manager.cc:931] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Time spent starting tablet: real 0.012s user 0.000s sys 0.000s 18:16:38.611 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.611284 9044 tablet_bootstrap.cc:432] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: No bootstrap required, opened a new log 18:16:38.611 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.611330 9044 ts_tablet_manager.cc:903] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.000s 18:16:38.611 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.611515 9044 raft_consensus.cc:286] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:38.611 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.611529 9044 raft_consensus.cc:312] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:38.613 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.612036 9044 raft_consensus.cc:575] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5a3ca82f6c4c88aeeca222d59ff40a, State: Initialized, Role: FOLLOWER 18:16:38.613 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.612063 9044 consensus_queue.cc:190] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:38.614 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.614253 9044 ts_tablet_manager.cc:931] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s 18:16:38.625 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.624788 9041 tablet_bootstrap.cc:432] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: No bootstrap required, opened a new log 18:16:38.625 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.624847 9041 ts_tablet_manager.cc:903] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.000s 18:16:38.625 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.625079 9041 raft_consensus.cc:286] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:38.625 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.625093 9041 raft_consensus.cc:312] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:38.625 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.625126 9041 raft_consensus.cc:575] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3476168b44e2452ebba1aa8d51aab35c, State: Initialized, Role: FOLLOWER 18:16:38.625 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.625141 9041 consensus_queue.cc:190] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:38.626 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067 returned Deferred@1569149433(state=PENDING, result=null, callback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089) -> (continuation of Deferred@745706024 after org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067), errback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089) -> (continuation of Deferred@745706024 after org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067)), so the following Deferred is getting paused: Deferred@745706024(state=PAUSED, result=Deferred@1569149433, callback=, errback=) 18:16:38.627 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.626251 9041 ts_tablet_manager.cc:931] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s 18:16:38.647 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@168764fb@377971963 returned Deferred@1569149433(state=PENDING, result=null, callback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089) -> (continuation of Deferred@745706024 after org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067) -> (continuation of Deferred@2010387584 after org.apache.kudu.client.AsyncKuduClient$12@168764fb@377971963), errback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089) -> (continuation of Deferred@745706024 after org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067) -> (continuation of Deferred@2010387584 after org.apache.kudu.client.AsyncKuduClient$12@168764fb@377971963)), so the following Deferred is getting paused: Deferred@2010387584(state=PAUSED, result=Deferred@1569149433, callback=, errback=) 18:16:38.656 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.656234 9050 raft_consensus.cc:411] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 18:16:38.656 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.656625 9050 raft_consensus.cc:2455] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Snoozing failure detection for 2.141s (starting election) 18:16:38.656 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.656867 9050 raft_consensus.cc:433] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:38.657 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.657232 9050 leader_election.cc:221] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 3476168b44e2452ebba1aa8d51aab35c 18:16:38.657 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.657802 9050 leader_election.cc:221] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer ed5a3ca82f6c4c88aeeca222d59ff40a 18:16:38.667 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@54bb8483@1421575299 returned Deferred@1569149433(state=PENDING, result=null, callback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089) -> (continuation of Deferred@745706024 after org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067) -> (continuation of Deferred@2010387584 after org.apache.kudu.client.AsyncKuduClient$12@168764fb@377971963) -> (continuation of Deferred@1826664430 after org.apache.kudu.client.AsyncKuduClient$12@54bb8483@1421575299), errback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089) -> (continuation of Deferred@745706024 after org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067) -> (continuation of Deferred@2010387584 after org.apache.kudu.client.AsyncKuduClient$12@168764fb@377971963) -> (continuation of Deferred@1826664430 after org.apache.kudu.client.AsyncKuduClient$12@54bb8483@1421575299)), so the following Deferred is getting paused: Deferred@1826664430(state=PAUSED, result=Deferred@1569149433, callback=, errback=) 18:16:38.677 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.677599 8454 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "18c3adcc54d34f609ea53c815477482d" candidate_uuid: "769021b95fba49269f11c58d171f33a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3476168b44e2452ebba1aa8d51aab35c" is_pre_election: true 18:16:38.678 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.677664 8454 raft_consensus.cc:2455] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: Snoozing failure detection for 1.682s (vote granted) 18:16:38.678 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.677685 8454 raft_consensus.cc:2009] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769021b95fba49269f11c58d171f33a6 in term 0. 18:16:38.677 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.677574 8086 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "18c3adcc54d34f609ea53c815477482d" candidate_uuid: "769021b95fba49269f11c58d171f33a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" is_pre_election: true 18:16:38.678 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.677640 8086 raft_consensus.cc:2455] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 2.207s (vote granted) 18:16:38.678 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.677657 8086 raft_consensus.cc:2009] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769021b95fba49269f11c58d171f33a6 in term 0. 18:16:38.677 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.677767 8217 leader_election.cc:353] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 pre-election: Vote granted by peer ed5a3ca82f6c4c88aeeca222d59ff40a 18:16:38.678 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.677795 8217 leader_election.cc:248] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 18:16:38.678 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.677991 9050 raft_consensus.cc:2455] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Snoozing failure detection for 1.766s (election complete) 18:16:38.679 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.678014 9050 raft_consensus.cc:2279] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Leader pre-election won for term 1 18:16:38.679 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.678025 9050 raft_consensus.cc:411] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 18:16:38.679 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.678033 9050 raft_consensus.cc:2455] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Snoozing failure detection for 1.759s (starting election) 18:16:38.679 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.678038 9050 raft_consensus.cc:2507] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 0 FOLLOWER]: Advancing to term 1 18:16:38.679 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.678289 8216 leader_election.cc:353] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 3476168b44e2452ebba1aa8d51aab35c 18:16:38.679 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.678829 9050 raft_consensus.cc:433] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:38.679 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.678985 9050 leader_election.cc:221] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 election: Requesting vote from peer 3476168b44e2452ebba1aa8d51aab35c 18:16:38.679 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.679920 8216 leader_election.cc:353] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 election: Vote granted by peer 3476168b44e2452ebba1aa8d51aab35c 18:16:38.680 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.679944 8216 leader_election.cc:248] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 18:16:38.680 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.680105 9050 leader_election.cc:221] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 election: Requesting vote from peer ed5a3ca82f6c4c88aeeca222d59ff40a 18:16:38.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.679154 8454 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "18c3adcc54d34f609ea53c815477482d" candidate_uuid: "769021b95fba49269f11c58d171f33a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3476168b44e2452ebba1aa8d51aab35c" 18:16:38.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.679181 8454 raft_consensus.cc:2507] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c [term 0 FOLLOWER]: Advancing to term 1 18:16:38.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.679214 8454 raft_consensus.cc:2455] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c: Snoozing failure detection for 1.506s (vote granted) 18:16:38.680 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.679814 8454 raft_consensus.cc:2009] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 769021b95fba49269f11c58d171f33a6 in term 1. 18:16:38.680 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.680294 8086 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "18c3adcc54d34f609ea53c815477482d" candidate_uuid: "769021b95fba49269f11c58d171f33a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" 18:16:38.680 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.680321 8086 raft_consensus.cc:2507] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a [term 0 FOLLOWER]: Advancing to term 1 18:16:38.680 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.680347 8086 raft_consensus.cc:2455] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a: Snoozing failure detection for 2.066s (vote granted) 18:16:38.681 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.681000 8086 raft_consensus.cc:2009] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 769021b95fba49269f11c58d171f33a6 in term 1. 18:16:38.681 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.681115 8217 leader_election.cc:353] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [CANDIDATE]: Term 1 election: Vote granted by peer ed5a3ca82f6c4c88aeeca222d59ff40a 18:16:38.686 [DEBUG - New I/O worker #69] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@41edbe35@1106099765 returned Deferred@1569149433(state=PENDING, result=null, callback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089) -> (continuation of Deferred@745706024 after org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067) -> (continuation of Deferred@2010387584 after org.apache.kudu.client.AsyncKuduClient$12@168764fb@377971963) -> (continuation of Deferred@1826664430 after org.apache.kudu.client.AsyncKuduClient$12@54bb8483@1421575299) -> (continuation of Deferred@382386844 after org.apache.kudu.client.AsyncKuduClient$12@41edbe35@1106099765), errback=(continuation of Deferred@1410126955 after org.apache.kudu.client.AsyncKuduClient$2@37063d0b@923155723) -> (continuation of Deferred@1299548411 after org.apache.kudu.client.AsyncKuduClient$12@7fe8b4e1@2145957089) -> (continuation of Deferred@745706024 after org.apache.kudu.client.AsyncKuduClient$12@4b9d1a3b@1268587067) -> (continuation of Deferred@2010387584 after org.apache.kudu.client.AsyncKuduClient$12@168764fb@377971963) -> (continuation of Deferred@1826664430 after org.apache.kudu.client.AsyncKuduClient$12@54bb8483@1421575299) -> (continuation of Deferred@382386844 after org.apache.kudu.client.AsyncKuduClient$12@41edbe35@1106099765)), so the following Deferred is getting paused: Deferred@382386844(state=PAUSED, result=Deferred@1569149433, callback=, errback=) 18:16:38.688 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.688642 9050 raft_consensus.cc:2455] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6: Snoozing failure detection for 1.726s (election complete) 18:16:38.688 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.688911 9050 raft_consensus.cc:2279] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 1 FOLLOWER]: Leader election won for term 1 18:16:38.689 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.689111 9050 raft_consensus.cc:541] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [term 1 LEADER]: Becoming Leader. State: Replica: 769021b95fba49269f11c58d171f33a6, State: Running, Role: LEADER 18:16:38.689 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.689498 9050 consensus_queue.cc:169] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } 18:16:38.705 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:38.705420 5543 catalog_manager.cc:2615] T 18c3adcc54d34f609ea53c815477482d reported cstate change: term changed from 0 to 1, leader changed from to 769021b95fba49269f11c58d171f33a6 (127.20.121.1). New cstate: current_term: 1 leader_uuid: "769021b95fba49269f11c58d171f33a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769021b95fba49269f11c58d171f33a6" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "3476168b44e2452ebba1aa8d51aab35c" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } peers { permanent_uuid: "ed5a3ca82f6c4c88aeeca222d59ff40a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } } 18:16:38.736 [DEBUG - Time-limited test] (AsyncKuduClient.java:1727) Learned about tablet 18c3adcc54d34f609ea53c815477482d for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:38.736 [DEBUG - Time-limited test] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=18c3adcc54d34f609ea53c815477482d, ttl=299999}] 18:16:38.764 [DEBUG - Hashed wheel timer #2] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@36b1fce1, flushNotification=Deferred@1941140563(state=PENDING, result=null, callback=, errback=)} 18:16:38.788 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:38.788117 8454 raft_consensus.cc:963] T 18c3adcc54d34f609ea53c815477482d P 3476168b44e2452ebba1aa8d51aab35c [term 1 FOLLOWER]: Refusing update from remote peer 769021b95fba49269f11c58d171f33a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 18:16:38.788 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.788708 9068 consensus_queue.cc:741] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [LEADER]: Connected to new peer: Peer: 3476168b44e2452ebba1aa8d51aab35c, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:38.789 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:38.789237 8086 raft_consensus.cc:963] T 18c3adcc54d34f609ea53c815477482d P ed5a3ca82f6c4c88aeeca222d59ff40a [term 1 FOLLOWER]: Refusing update from remote peer 769021b95fba49269f11c58d171f33a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 18:16:38.789 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:38.789667 9050 consensus_queue.cc:741] T 18c3adcc54d34f609ea53c815477482d P 769021b95fba49269f11c58d171f33a6 [LEADER]: Connected to new peer: Peer: ed5a3ca82f6c4c88aeeca222d59ff40a, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:38.925 [DEBUG - Hashed wheel timer #2] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@428ac38b, flushNotification=Deferred@2070247887(state=PENDING, result=null, callback=, errback=)} 18:16:39.045 [DEBUG - Hashed wheel timer #2] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@139c8b1c, flushNotification=Deferred@613966348(state=PENDING, result=null, callback=, errback=)} 18:16:39.338 [DEBUG - main] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@105fece7, flushNotification=Deferred@1052967153(state=PENDING, result=null, callback=, errback=)} 18:16:39.339 [DEBUG - main] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@482cd91f@1210898719 returned Deferred@306123060(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1485159264 after org.apache.kudu.client.AsyncKuduSession$1@482cd91f@1210898719), errback=passthrough -> (continuation of Deferred@1485159264 after org.apache.kudu.client.AsyncKuduSession$1@482cd91f@1210898719)), so the following Deferred is getting paused: Deferred@1485159264(state=PAUSED, result=Deferred@306123060, callback=, errback=) 18:16:39.348 [DEBUG - New I/O worker #69] (AsyncKuduClient.java:950) Notify RPC Batch{operations=1, tablet="5ceb1b36c63b4045be78db7318693bc3" [, ), ignoreAllDuplicateRows=false, rpc=KuduRpc(method=Write, tablet=null, attempt=1, DeadlineTracker(timeout=30000, elapsed=2), Traces: [0ms] querying master, [0ms] Sub rpc: GetTableLocations sending RPC to server , [2ms] Sub rpc: GetTableLocations received from server response Not found: The table was deleted: Table deleted at 2017-09-20 18:16:38 UTC (error 0), Deferred@509465434(state=PENDING, result=null, callback=apply batch response, errback=apply batch error response))} after lookup exception org.apache.kudu.client.NonRecoverableException: The table was deleted: Table deleted at 2017-09-20 18:16:38 UTC at org.apache.kudu.client.RpcProxy.dispatchMasterError(RpcProxy.java:360) at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:253) at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:60) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:132) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:128) at org.apache.kudu.client.Connection.messageReceived(Connection.java:375) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.Connection.handleUpstream(Connection.java:239) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.handler.timeout.ReadTimeoutHandler.messageReceived(ReadTimeoutHandler.java:184) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 18:16:39.353 [WARN - New I/O worker #69] (BaseKuduTest.java:322) Got exception com.stumbleupon.async.DeferredGroupException: At least one of the Deferreds failed, first exception: at com.stumbleupon.async.DeferredGroup.done(DeferredGroup.java:169) at com.stumbleupon.async.DeferredGroup.recordCompletion(DeferredGroup.java:142) at com.stumbleupon.async.DeferredGroup.access$000(DeferredGroup.java:36) at com.stumbleupon.async.DeferredGroup$1Notify.call(DeferredGroup.java:82) at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280) at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) at com.stumbleupon.async.Deferred.access$300(Deferred.java:427) at com.stumbleupon.async.Deferred$Continue.call(Deferred.java:1368) at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280) at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) at com.stumbleupon.async.Deferred.callback(Deferred.java:1002) at org.apache.kudu.client.AsyncKuduSession$TabletLookupCB$1.call(AsyncKuduSession.java:404) at org.apache.kudu.client.AsyncKuduSession$TabletLookupCB$1.call(AsyncKuduSession.java:400) at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280) at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) at com.stumbleupon.async.Deferred.callback(Deferred.java:1002) at com.stumbleupon.async.DeferredGroup.done(DeferredGroup.java:169) at com.stumbleupon.async.DeferredGroup.recordCompletion(DeferredGroup.java:142) at com.stumbleupon.async.DeferredGroup.access$000(DeferredGroup.java:36) at com.stumbleupon.async.DeferredGroup$1Notify.call(DeferredGroup.java:82) at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280) at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315) at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286) at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) at com.stumbleupon.async.Deferred.callback(Deferred.java:1002) at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:238) at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:292) at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:276) at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:60) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:132) at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:128) at org.apache.kudu.client.Connection.messageReceived(Connection.java:375) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.Connection.handleUpstream(Connection.java:239) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.handler.timeout.ReadTimeoutHandler.messageReceived(ReadTimeoutHandler.java:184) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: com.stumbleupon.async.DeferredGroupException: At least one of the Deferreds failed, first exception: ... 55 more Caused by: org.apache.kudu.client.NonRecoverableException: The table was deleted: Table deleted at 2017-09-20 18:16:38 UTC at org.apache.kudu.client.RpcProxy.dispatchMasterError(RpcProxy.java:360) at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:253) ... 42 more 18:16:39.377 [DEBUG - New I/O worker #67] (Connection.java:666) [peer master-127.20.121.1:64032] cleaning up while in state READY due to: connection disconnected 18:16:39.378 [DEBUG - New I/O worker #2] (Connection.java:666) [peer master-127.20.121.1:64032] cleaning up while in state READY due to: connection disconnected 18:16:39.388 [DEBUG - New I/O worker #68] (Connection.java:666) [peer master-127.20.121.1:64034] cleaning up while in state READY due to: connection disconnected 18:16:39.391 [DEBUG - New I/O worker #3] (Connection.java:666) [peer master-127.20.121.1:64034] cleaning up while in state READY due to: connection disconnected 18:16:39.420 [DEBUG - New I/O worker #69] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 18:16:39.423 [DEBUG - New I/O worker #4] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 18:16:39.423 [DEBUG - New I/O worker #66] (Connection.java:666) [peer master-127.20.121.1:64030] cleaning up while in state READY due to: connection disconnected 18:16:39.423 [DEBUG - New I/O worker #1] (Connection.java:666) [peer master-127.20.121.1:64030] cleaning up while in state READY due to: connection disconnected 18:16:39.429 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) *** Aborted at 1505931399 (unix time) try "date -d @1505931399" if you are using GNU date *** 18:16:39.429 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) PC: @ 0x7f29e35a3d4d nanosleep 18:16:39.430 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) *** SIGTERM (@0x3e800001479) received by PID 7953 (TID 0x7f29e55f2880) from PID 5241; stack trace: *** 18:16:39.430 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) @ 0x7f29e3515cb0 (unknown) 18:16:39.430 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) @ 0x7f29e35a3d4d nanosleep 18:16:39.444 [DEBUG - New I/O worker #72] (Connection.java:666) [peer ed5a3ca82f6c4c88aeeca222d59ff40a] cleaning up while in state READY due to: connection disconnected 18:16:39.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) *** Aborted at 1505931399 (unix time) try "date -d @1505931399" if you are using GNU date *** 18:16:39.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) PC: @ 0x7f862c8c6d4d nanosleep 18:16:39.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) *** SIGTERM (@0x3e800001479) received by PID 8170 (TID 0x7f862e915880) from PID 5241; stack trace: *** 18:16:39.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7f862c838cb0 (unknown) 18:16:39.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7f862c8c6d4d nanosleep 18:16:39.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x7f862d34e718 base::SleepForNanoseconds() 18:16:39.452 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) @ 0x4024ec kudu::tserver::TabletServerMain() 18:16:39.462 [DEBUG - New I/O worker #73] (Connection.java:666) [peer 769021b95fba49269f11c58d171f33a6] cleaning up while in state READY due to: connection disconnected 18:16:39.551 [INFO - main] (BaseKuduTest.java:75) Setting up before class... 18:16:39.551 [INFO - main] (MiniKuduCluster.java:152) Starting 3 masters... 18:16:39.700 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:39.700 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:39.700515 9245 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:39.702 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:39.702105 9245 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 18:16:39.702 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:39.702127 9245 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:39.702 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:39.702133 9245 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 18:16:39.702 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:39.702144 9245 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:39.703 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.703536 9245 master_main.cc:66] Master server non-default flags: 18:16:39.703 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:39.703 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 18:16:39.703 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931399554/data 18:16:39.703 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931399554/data 18:16:39.703 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 18:16:39.703 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --master_addresses=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64030 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --webserver_port=64031 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --never_fsync=true 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.9245 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931399554/logs 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) --logtostderr=true 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Master server version: 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:39.704 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:39.705 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build type RELEASE 18:16:39.705 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:39.705 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) build id 10042 18:16:39.705 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.703846 9245 minidump.cc:237] Setting minidump size limit to 20M 18:16:39.760 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.760581 9245 master_main.cc:73] Initializing master server... 18:16:39.760 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.760890 9245 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 691139 18:16:39.761 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.761175 9245 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931399554/data/instance: No such file or directory (error 2) 18:16:39.761 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.761190 9245 server_base.cc:229] Creating new FS layout 18:16:39.762 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.762913 9245 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931399554/data/instance: 18:16:39.763 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "8802ab04d6f24637a95e0854b7d63883" 18:16:39.763 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:39 on jenkins-slave-c3oe" 18:16:39.788 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.788785 9245 fs_manager.cc:434] Time spent creating directory manager: real 0.026s user 0.000s sys 0.008s 18:16:39.789 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.789408 9245 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:39.789 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.789609 9245 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:39.812 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.812727 9245 fs_manager.cc:336] Time spent opening block manager: real 0.022s user 0.000s sys 0.000s 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.812799 9245 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931399554/data 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) uuid: "8802ab04d6f24637a95e0854b7d63883" 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:39 on jenkins-slave-c3oe" 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:39.812839 9245 fs_report.cc:347] Block manager report 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) -------------------- 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-0-1505931399554/data/data 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:39.813 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:40.015 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:40.015 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:40.015075 9293 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:40.016 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:40.016165 9293 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 18:16:40.016 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:40.016185 9293 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:40.016 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:40.016188 9293 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 18:16:40.016 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) W0920 18:16:40.016196 9293 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:40.017 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.017419 9293 master_main.cc:66] Master server non-default flags: 18:16:40.017 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:40.017 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 18:16:40.017 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931399554/data 18:16:40.017 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931399554/data 18:16:40.017 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 18:16:40.017 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --master_addresses=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:40.018 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.017953 9245 master_main.cc:76] Starting Master server... 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64032 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --webserver_port=64033 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --never_fsync=true 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.9293 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:40.018 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931399554/logs 18:16:40.019 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) --logtostderr=true 18:16:40.019 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Master server version: 18:16:40.019 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:40.019 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:40.019 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build type RELEASE 18:16:40.019 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:40.019 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) build id 10042 18:16:40.019 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.017729 9293 minidump.cc:237] Setting minidump size limit to 20M 18:16:40.036 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.036540 9315 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:40.036 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.036859 9315 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:40.037 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.037046 9315 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:40.056 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.056535 9293 master_main.cc:73] Initializing master server... 18:16:40.056 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.056838 9293 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 691639 18:16:40.057 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.057021 9293 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931399554/data/instance: No such file or directory (error 2) 18:16:40.057 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.057032 9293 server_base.cc:229] Creating new FS layout 18:16:40.059 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.059255 9293 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931399554/data/instance: 18:16:40.059 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "4f53e62698ff4c7d881b40dc1ad53190" 18:16:40.059 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:40 on jenkins-slave-c3oe" 18:16:40.088 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.088798 9293 fs_manager.cc:434] Time spent creating directory manager: real 0.029s user 0.004s sys 0.004s 18:16:40.089 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.089058 9293 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:40.089 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.089092 9293 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:40.104 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.104722 9293 fs_manager.cc:336] Time spent opening block manager: real 0.015s user 0.000s sys 0.004s 18:16:40.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.104795 9293 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931399554/data 18:16:40.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) uuid: "4f53e62698ff4c7d881b40dc1ad53190" 18:16:40.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:40 on jenkins-slave-c3oe" 18:16:40.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.104833 9293 fs_report.cc:347] Block manager report 18:16:40.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) -------------------- 18:16:40.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-1-1505931399554/data/data 18:16:40.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:40.105 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:40.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:40.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:40.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:40.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:40.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:40.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:40.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:40.106 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:40.318 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:40.318 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:40.318291 9372 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:40.319 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:40.319278 9372 flags.cc:395] Enabled experimental flag: --ipki_ca_key_size=1024 18:16:40.319 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:40.319293 9372 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:40.319 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:40.319298 9372 flags.cc:395] Enabled experimental flag: --tsk_num_rsa_bits=512 18:16:40.319 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) W0920 18:16:40.319308 9372 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:40.320 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.320374 9372 master_main.cc:66] Master server non-default flags: 18:16:40.320 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:40.320 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --raft_heartbeat_interval_ms=200 18:16:40.320 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931399554/data 18:16:40.320 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931399554/data 18:16:40.320 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_ca_key_size=1024 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --master_addresses=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --tsk_num_rsa_bits=512 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64034 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --webserver_port=64035 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --never_fsync=true 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-master.9372 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931399554/logs 18:16:40.321 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) --logtostderr=true 18:16:40.322 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Master server version: 18:16:40.322 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:40.322 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:40.322 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build type RELEASE 18:16:40.322 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:40.322 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) build id 10042 18:16:40.328 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.328691 9293 master_main.cc:76] Starting Master server... 18:16:40.336 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.336712 9372 minidump.cc:237] Setting minidump size limit to 20M 18:16:40.372 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.372547 9406 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:40.372 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.372587 9406 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:40.372 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.372593 9406 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:40.390 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.390204 9372 master_main.cc:73] Initializing master server... 18:16:40.390 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.390766 9372 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 691639 18:16:40.391 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.390950 9372 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931399554/data/instance: No such file or directory (error 2) 18:16:40.391 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.390969 9372 server_base.cc:229] Creating new FS layout 18:16:40.393 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.393223 9372 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931399554/data/instance: 18:16:40.393 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "20443f3ace2443fea129c83cbf1d813e" 18:16:40.393 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:40 on jenkins-slave-c3oe" 18:16:40.404 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.404858 9372 fs_manager.cc:434] Time spent creating directory manager: real 0.011s user 0.000s sys 0.000s 18:16:40.405 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.405439 9372 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:40.405 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.405618 9372 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:40.420 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.420734 9372 fs_manager.cc:336] Time spent opening block manager: real 0.014s user 0.004s sys 0.000s 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.421136 9372 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931399554/data 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) uuid: "20443f3ace2443fea129c83cbf1d813e" 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:40 on jenkins-slave-c3oe" 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.421484 9372 fs_report.cc:347] Block manager report 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) -------------------- 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/master-2-1505931399554/data/data 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:40.421 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:40.422 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:40.422 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:40.422 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:40.422 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:40.422 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:40.544 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.544669 9372 master_main.cc:76] Starting Master server... 18:16:40.553 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.552942 9471 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:40.553 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.553333 9471 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:40.553 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.553489 9471 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:40.580 [INFO - main] (MiniKuduCluster.java:155) Starting 3 tablet servers... 18:16:40.642 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:40.643 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:40.642601 9482 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:40.644 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:40.644204 9482 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:40.644 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:40.644407 9482 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:40.644 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) W0920 18:16:40.644605 9482 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.646062 9482 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931400581/data 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931400581/data 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64036 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --webserver_port=64037 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --never_fsync=true 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.9482 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:40.646 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931400581/logs 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) --logtostderr=true 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Tablet server version: 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build type RELEASE 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:40.647 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) build id 10042 18:16:40.648 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.648156 9482 minidump.cc:237] Setting minidump size limit to 20M 18:16:40.696 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.696529 9482 tablet_server_main.cc:79] Initializing tablet server... 18:16:40.697 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.697212 9482 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 691639 18:16:40.697 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.697391 9482 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931400581/data/instance: No such file or directory (error 2) 18:16:40.697 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.697516 9482 server_base.cc:229] Creating new FS layout 18:16:40.699 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.699786 9482 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931400581/data/instance: 18:16:40.699 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "65d781800b71422fb6975551ca462208" 18:16:40.700 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:40 on jenkins-slave-c3oe" 18:16:40.713 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.713505 9482 fs_manager.cc:434] Time spent creating directory manager: real 0.014s user 0.000s sys 0.004s 18:16:40.714 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.714285 9482 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:40.714 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.714498 9482 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:40.728 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.728883 9482 fs_manager.cc:336] Time spent opening block manager: real 0.013s user 0.000s sys 0.000s 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.728974 9482 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931400581/data 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) uuid: "65d781800b71422fb6975551ca462208" 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:40 on jenkins-slave-c3oe" 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.729037 9482 fs_report.cc:347] Block manager report 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) -------------------- 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-0-1505931400581/data/data 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:40.729 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:40.730 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:40.730 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:40.800 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.800647 9245 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64030 18:16:40.800 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.800745 9245 webserver.cc:149] Starting webserver on 127.20.121.1:64031 18:16:40.800 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.800752 9245 webserver.cc:160] Document root disabled 18:16:40.801 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.800951 9245 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64031/ 18:16:40.818 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.818292 9595 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 18:16:40.828 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.827942 9482 ts_tablet_manager.cc:296] Loaded tablet metadata (0 live tablets) 18:16:40.832 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.832516 9595 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 18:16:40.833 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:40.833122 9595 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64032: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64032: connect: Connection refused (error 111) 18:16:40.836 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:40.836760 9482 tablet_server_main.cc:84] Starting tablet server... 18:16:40.879 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.879324 9595 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } attempt: 1 18:16:40.880 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:40.880127 9595 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64032: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64032: connect: Connection refused (error 111) 18:16:40.929 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:40.929280 9595 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } attempt: 2 18:16:40.930 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) W0920 18:16:40.930016 9595 consensus_peers.cc:540] Error getting permanent uuid from config peer 127.20.121.1:64032: Network error: Client connection negotiation failed: client connection to 127.20.121.1:64032: connect: Connection refused (error 111) 18:16:40.949 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.949383 9372 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64034 18:16:40.949 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.949813 9293 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64032 18:16:40.950 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.950067 9372 webserver.cc:149] Starting webserver on 127.20.121.1:64035 18:16:40.950 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.950294 9293 webserver.cc:149] Starting webserver on 127.20.121.1:64033 18:16:40.950 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.950458 9372 webserver.cc:160] Document root disabled 18:16:40.950 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.950628 9293 webserver.cc:160] Document root disabled 18:16:40.951 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.951009 9372 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64035/ 18:16:40.951 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.951344 9293 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64033/ 18:16:40.968 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.968230 9684 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 18:16:40.970 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.970319 9682 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } has no permanent_uuid. Determining permanent_uuid... 18:16:40.981 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.981786 9684 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 18:16:40.998 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:40.998057 9684 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 18:16:40.998 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:40.998886 9682 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } has no permanent_uuid. Determining permanent_uuid... 18:16:41.003 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.003736 9682 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 18:16:41.014 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.014166 9595 consensus_peers.cc:550] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } attempt: 3 18:16:41.019 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.019193 9595 sys_catalog.cc:293] member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } has no permanent_uuid. Determining permanent_uuid... 18:16:41.026 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:41.027 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.027072 9684 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: Bootstrap starting. 18:16:41.028 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.027581 9684 tablet_bootstrap.cc:567] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: No blocks or log segments found. Creating new log. 18:16:41.028 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.027846 9684 log.cc:519] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: Log is configured to *not* fsync() on all Append() calls 18:16:41.036 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.035655 9682 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190: Bootstrap starting. 18:16:41.036 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:41.026573 9649 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:41.036 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.035632 9595 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883: Bootstrap starting. 18:16:41.036 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.036125 9595 tablet_bootstrap.cc:567] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883: No blocks or log segments found. Creating new log. 18:16:41.036 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.036389 9595 log.cc:519] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883: Log is configured to *not* fsync() on all Append() calls 18:16:41.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.036782 9684 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: No bootstrap required, opened a new log 18:16:41.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.037097 9684 raft_consensus.cc:286] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:41.037 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.037123 9684 raft_consensus.cc:312] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:41.038 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:41.038000 9649 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:41.038 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:41.038163 9649 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:41.038 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) W0920 18:16:41.038314 9649 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:41.039 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.039737 9649 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:41.039 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:41.039 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931400581/data 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931400581/data 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64038 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --webserver_port=64039 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --never_fsync=true 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.9649 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931400581/logs 18:16:41.040 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) --logtostderr=true 18:16:41.041 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Tablet server version: 18:16:41.041 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:41.041 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:41.041 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build type RELEASE 18:16:41.041 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:41.041 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) build id 10042 18:16:41.044 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.044560 9684 raft_consensus.cc:575] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20443f3ace2443fea129c83cbf1d813e, State: Initialized, Role: FOLLOWER 18:16:41.044 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.044854 9684 consensus_queue.cc:190] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:41.045 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.044945 9595 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883: No bootstrap required, opened a new log 18:16:41.045 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.045269 9595 raft_consensus.cc:286] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:41.045 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.045294 9595 raft_consensus.cc:312] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:41.045 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.045338 9595 raft_consensus.cc:575] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8802ab04d6f24637a95e0854b7d63883, State: Initialized, Role: FOLLOWER 18:16:41.045 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.045363 9595 consensus_queue.cc:190] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:41.049 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.048705 9682 tablet_bootstrap.cc:567] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190: No blocks or log segments found. Creating new log. 18:16:41.049 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.049021 9682 log.cc:519] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190: Log is configured to *not* fsync() on all Append() calls 18:16:41.049 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.049501 9649 minidump.cc:237] Setting minidump size limit to 20M 18:16:41.050 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.050235 9595 sys_catalog.cc:321] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.050 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.050264 9595 sys_catalog.cc:324] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.050 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.050384 9595 sys_catalog.cc:408] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: configured and running, proceeding with master startup. 18:16:41.050 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.050969 9723 sys_catalog.cc:321] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.051 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.051201 9723 sys_catalog.cc:324] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.052 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.052479 9717 raft_consensus.cc:411] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 18:16:41.052 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.052691 9717 raft_consensus.cc:2455] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: Snoozing failure detection for 0.763s (starting election) 18:16:41.052 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.052886 9717 raft_consensus.cc:433] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:41.053 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.053288 9717 leader_election.cc:221] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 8802ab04d6f24637a95e0854b7d63883 18:16:41.053 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.053606 9717 leader_election.cc:221] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 4f53e62698ff4c7d881b40dc1ad53190 18:16:41.055 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.054621 9682 tablet_bootstrap.cc:432] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190: No bootstrap required, opened a new log 18:16:41.055 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.054949 9682 raft_consensus.cc:286] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:41.055 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.054975 9682 raft_consensus.cc:312] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:41.055 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.055017 9682 raft_consensus.cc:575] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f53e62698ff4c7d881b40dc1ad53190, State: Initialized, Role: FOLLOWER 18:16:41.055 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.055043 9682 consensus_queue.cc:190] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:41.055 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.055755 9684 sys_catalog.cc:321] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.056 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.055783 9684 sys_catalog.cc:324] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.056 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.055898 9684 sys_catalog.cc:408] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [sys.catalog]: configured and running, proceeding with master startup. 18:16:41.056 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.056349 9717 sys_catalog.cc:321] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.056 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.056365 9717 sys_catalog.cc:324] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.056 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.056558 9727 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 18:16:41.056 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.056820 9245 master_main.cc:79] Master server successfully started. 18:16:41.057 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.057459 9456 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20443f3ace2443fea129c83cbf1d813e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8802ab04d6f24637a95e0854b7d63883" is_pre_election: true 18:16:41.057 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.057530 9456 raft_consensus.cc:2455] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883: Snoozing failure detection for 0.661s (vote granted) 18:16:41.057 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.057551 9456 raft_consensus.cc:2009] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20443f3ace2443fea129c83cbf1d813e in term 0. 18:16:41.057 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.057737 9433 leader_election.cc:353] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 pre-election: Vote granted by peer 8802ab04d6f24637a95e0854b7d63883 18:16:41.057 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.057757 9433 leader_election.cc:248] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 18:16:41.058 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.058655 9682 sys_catalog.cc:321] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.058 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.058681 9682 sys_catalog.cc:324] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.059 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.058782 9682 sys_catalog.cc:408] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: configured and running, proceeding with master startup. 18:16:41.059 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.058040 9717 raft_consensus.cc:2455] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: Snoozing failure detection for 0.623s (election complete) 18:16:41.059 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.058063 9717 raft_consensus.cc:2279] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 0 FOLLOWER]: Leader pre-election won for term 1 18:16:41.059 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.058075 9717 raft_consensus.cc:411] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 18:16:41.059 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.058084 9717 raft_consensus.cc:2455] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: Snoozing failure detection for 0.876s (starting election) 18:16:41.059 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.058089 9717 raft_consensus.cc:2507] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 0 FOLLOWER]: Advancing to term 1 18:16:41.059 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.058832 9717 raft_consensus.cc:433] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:41.059 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.058986 9717 leader_election.cc:221] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 election: Requesting vote from peer 8802ab04d6f24637a95e0854b7d63883 18:16:41.059 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.059022 9717 leader_election.cc:221] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 election: Requesting vote from peer 4f53e62698ff4c7d881b40dc1ad53190 18:16:41.059 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.059929 9456 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20443f3ace2443fea129c83cbf1d813e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8802ab04d6f24637a95e0854b7d63883" 18:16:41.060 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.059957 9456 raft_consensus.cc:2507] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [term 0 FOLLOWER]: Advancing to term 1 18:16:41.060 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.059984 9456 raft_consensus.cc:2455] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883: Snoozing failure detection for 0.877s (vote granted) 18:16:41.060 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.060021 9555 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20443f3ace2443fea129c83cbf1d813e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f53e62698ff4c7d881b40dc1ad53190" is_pre_election: true 18:16:41.060 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.060075 9555 raft_consensus.cc:2455] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190: Snoozing failure detection for 0.856s (vote granted) 18:16:41.060 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.060091 9555 raft_consensus.cc:2009] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20443f3ace2443fea129c83cbf1d813e in term 0. 18:16:41.060 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.060231 9449 leader_election.cc:353] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 pre-election: Vote granted by peer 4f53e62698ff4c7d881b40dc1ad53190 18:16:41.060 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.060693 9433 leader_election.cc:353] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 election: Vote granted by peer 8802ab04d6f24637a95e0854b7d63883 18:16:41.060 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.060705 9433 leader_election.cc:248] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 18:16:41.060 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.060576 9456 raft_consensus.cc:2009] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20443f3ace2443fea129c83cbf1d813e in term 1. 18:16:41.060 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.060891 9722 raft_consensus.cc:2455] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: Snoozing failure detection for 0.756s (election complete) 18:16:41.061 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.061023 9722 raft_consensus.cc:2279] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 1 FOLLOWER]: Leader election won for term 1 18:16:41.061 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.061127 9722 raft_consensus.cc:541] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [term 1 LEADER]: Becoming Leader. State: Replica: 20443f3ace2443fea129c83cbf1d813e, State: Running, Role: LEADER 18:16:41.061 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.061355 9722 consensus_queue.cc:169] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } 18:16:41.061 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.061786 9730 sys_catalog.cc:321] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 leader_uuid: "" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.062 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.062193 9730 sys_catalog.cc:324] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.068 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.068027 9731 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 18:16:41.068 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.068163 9732 catalog_manager.cc:493] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: 1 18:16:41.069 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.069825 9293 master_main.cc:79] Master server successfully started. 18:16:41.069 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.069826 9550 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20443f3ace2443fea129c83cbf1d813e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f53e62698ff4c7d881b40dc1ad53190" 18:16:41.070 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.069891 9550 raft_consensus.cc:2507] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [term 0 FOLLOWER]: Advancing to term 1 18:16:41.070 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.069962 9550 raft_consensus.cc:2455] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190: Snoozing failure detection for 0.872s (vote granted) 18:16:41.069 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.069892 9372 master_main.cc:79] Master server successfully started. 18:16:41.070 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.070669 9550 raft_consensus.cc:2009] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20443f3ace2443fea129c83cbf1d813e in term 1. 18:16:41.070 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.070909 9449 leader_election.cc:353] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [CANDIDATE]: Term 1 election: Vote granted by peer 4f53e62698ff4c7d881b40dc1ad53190 18:16:41.076 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.076722 9717 sys_catalog.cc:321] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20443f3ace2443fea129c83cbf1d813e. Latest consensus state: current_term: 1 leader_uuid: "20443f3ace2443fea129c83cbf1d813e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.076 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.076756 9717 sys_catalog.cc:324] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [sys.catalog]: This master's current role is: LEADER 18:16:41.079 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.079620 9649 tablet_server_main.cc:79] Initializing tablet server... 18:16:41.080 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.079906 9649 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 692139 18:16:41.080 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.080745 9748 catalog_manager.cc:1049] Loading table and tablet metadata into memory... 18:16:41.088 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.084615 9649 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931400581/data/instance: No such file or directory (error 2) 18:16:41.088 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.084636 9649 server_base.cc:229] Creating new FS layout 18:16:41.088 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.086901 9649 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931400581/data/instance: 18:16:41.088 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "9d9c953c8fd2435f8c241d072f0c543a" 18:16:41.088 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:41 on jenkins-slave-c3oe" 18:16:41.096 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.096791 9649 fs_manager.cc:434] Time spent creating directory manager: real 0.010s user 0.004s sys 0.000s 18:16:41.097 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.097348 9649 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:41.097 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.097543 9649 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:41.108 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.108747 9649 fs_manager.cc:336] Time spent opening block manager: real 0.010s user 0.004s sys 0.000s 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.109122 9649 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931400581/data 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) uuid: "9d9c953c8fd2435f8c241d072f0c543a" 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:41 on jenkins-slave-c3oe" 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.109441 9649 fs_report.cc:347] Block manager report 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) -------------------- 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-1-1505931400581/data/data 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:41.109 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:41.110 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:41.110 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:41.110 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:41.110 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:41.116 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.115634 9482 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64036 18:16:41.116 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.115710 9482 webserver.cc:149] Starting webserver on 127.20.121.1:64037 18:16:41.116 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.115718 9482 webserver.cc:160] Document root disabled 18:16:41.116 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.115921 9482 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64037/ 18:16:41.116 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.116689 9748 catalog_manager.cc:1060] Initializing Kudu internal certificate authority... 18:16:41.121 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.121898 9827 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:41.122 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.121961 9827 heartbeater.cc:387] Registering TS with master... 18:16:41.122 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.122077 9827 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:41.122 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.122467 9378 ts_manager.cc:81] Registered new tserver with Master: 65d781800b71422fb6975551ca462208 (127.20.121.1:64036) 18:16:41.126 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.126049 9829 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:41.126 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.126294 9829 heartbeater.cc:387] Registering TS with master... 18:16:41.126 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.126483 9829 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:41.126 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.126932 9508 ts_manager.cc:81] Registered new tserver with Master: 65d781800b71422fb6975551ca462208 (127.20.121.1:64036) 18:16:41.127 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.127390 9482 tablet_server_main.cc:87] Tablet server successfully started. 18:16:41.127 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.127329 9835 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:41.127 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.127421 9835 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:41.127 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.127429 9835 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:41.130 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.130774 9832 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:41.130 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.130964 9832 heartbeater.cc:387] Registering TS with master... 18:16:41.131 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:41.131136 9832 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:41.131 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.131511 9514 ts_manager.cc:81] Registered new tserver with Master: 65d781800b71422fb6975551ca462208 (127.20.121.1:64036) 18:16:41.186 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.185926 9550 raft_consensus.cc:963] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [term 1 FOLLOWER]: Refusing update from remote peer 20443f3ace2443fea129c83cbf1d813e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 18:16:41.187 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.186216 9717 consensus_queue.cc:741] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [LEADER]: Connected to new peer: Peer: 4f53e62698ff4c7d881b40dc1ad53190, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:41.188 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.188495 9456 raft_consensus.cc:963] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [term 1 FOLLOWER]: Refusing update from remote peer 20443f3ace2443fea129c83cbf1d813e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 18:16:41.190 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.190309 9730 sys_catalog.cc:321] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20443f3ace2443fea129c83cbf1d813e. Latest consensus state: current_term: 1 leader_uuid: "20443f3ace2443fea129c83cbf1d813e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.190 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.190335 9730 sys_catalog.cc:324] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.190 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.188822 9717 consensus_queue.cc:741] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e [LEADER]: Connected to new peer: Peer: 8802ab04d6f24637a95e0854b7d63883, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:41.191 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.190995 9723 sys_catalog.cc:321] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20443f3ace2443fea129c83cbf1d813e. Latest consensus state: current_term: 1 leader_uuid: "20443f3ace2443fea129c83cbf1d813e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.191 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.191015 9723 sys_catalog.cc:324] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.200 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.200866 9723 sys_catalog.cc:321] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "20443f3ace2443fea129c83cbf1d813e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.201 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.200901 9723 sys_catalog.cc:324] T 00000000000000000000000000000000 P 8802ab04d6f24637a95e0854b7d63883 [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.202 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.201990 9730 sys_catalog.cc:321] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "20443f3ace2443fea129c83cbf1d813e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8802ab04d6f24637a95e0854b7d63883" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64030 } } peers { permanent_uuid: "4f53e62698ff4c7d881b40dc1ad53190" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64032 } } peers { permanent_uuid: "20443f3ace2443fea129c83cbf1d813e" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64034 } } } 18:16:41.202 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.202021 9730 sys_catalog.cc:324] T 00000000000000000000000000000000 P 4f53e62698ff4c7d881b40dc1ad53190 [sys.catalog]: This master's current role is: FOLLOWER 18:16:41.225 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.225190 9748 catalog_manager.cc:947] Generated new certificate authority record 18:16:41.233 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.226128 9748 catalog_manager.cc:1069] Loading token signing keys... 18:16:41.253 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.253526 9748 catalog_manager.cc:3648] T 00000000000000000000000000000000 P 20443f3ace2443fea129c83cbf1d813e: Generated new TSK 0 18:16:41.254 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.254765 9649 ts_tablet_manager.cc:296] Loaded tablet metadata (0 live tablets) 18:16:41.268 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.268482 9649 tablet_server_main.cc:84] Starting tablet server... 18:16:41.318 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) WARNING: Logging before InitGoogleLogging() is written to STDERR 18:16:41.318 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:41.317952 9863 flags.cc:395] Enabled unsafe flag: --never_fsync=true 18:16:41.319 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:41.319020 9863 flags.cc:395] Enabled experimental flag: --ipki_server_key_size=1024 18:16:41.319 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:41.319046 9863 flags.cc:395] Enabled experimental flag: --flush_threshold_mb=1 18:16:41.319 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) W0920 18:16:41.319056 9863 flags.cc:395] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.121.1 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.320343 9863 tablet_server_main.cc:72] Tablet server non-default flags: 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_preallocate_segments=false 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_data_dirs=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931400581/data 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --fs_wal_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931400581/data 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --ipki_server_key_size=1024 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --rpc_bind_addresses=127.20.121.1:64040 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_interface=127.20.121.1 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --webserver_port=64041 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flush_threshold_mb=1 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --tserver_master_addrs=127.20.121.1:64030,127.20.121.1:64032,127.20.121.1:64034 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --never_fsync=true 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --heap_profile_path=/tmp/kudu-tserver.9863 18:16:41.320 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_experimental_flags=true 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --unlock_unsafe_flags=true 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --local_ip_for_outbound_sockets=127.20.121.1 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --flagfile=/home/jenkins-slave/workspace/kudu-master/2/java/kudu-client/target/test-classes/flags 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --log_dir=/home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931400581/logs 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) --logtostderr=true 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Tablet server version: 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) kudu 1.6.0-SNAPSHOT 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) revision 76c71193ad418cec9be5db6e7f74ce0459e6cd88 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build type RELEASE 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) built by None at 20 Sep 2017 18:06:15 UTC on jenkins-slave-c3oe 18:16:41.321 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) build id 10042 18:16:41.334 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.334019 9863 minidump.cc:237] Setting minidump size limit to 20M 18:16:41.372 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.372525 9863 tablet_server_main.cc:79] Initializing tablet server... 18:16:41.373 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.373275 9863 system_ntp.cc:104] NTP initialized. Resolution in nanos?: 1 Skew PPM: 500 Current error: 692139 18:16:41.373 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.373687 9863 server_base.cc:228] Could not load existing FS layout: Not found: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931400581/data/instance: No such file or directory (error 2) 18:16:41.373 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.373867 9863 server_base.cc:229] Creating new FS layout 18:16:41.376 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.376724 9863 fs_manager.cc:477] Generated new instance metadata in path /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931400581/data/instance: 18:16:41.376 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" 18:16:41.376 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:41 on jenkins-slave-c3oe" 18:16:41.392 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.392802 9863 fs_manager.cc:434] Time spent creating directory manager: real 0.016s user 0.000s sys 0.004s 18:16:41.393 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.393474 9863 env_posix.cc:1588] Not raising process file limit of 65536; it is already as high as it can go 18:16:41.393 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.393697 9863 file_cache.cc:470] Constructed file cache lbm with capacity 26214 18:16:41.409 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.409241 9863 fs_manager.cc:336] Time spent opening block manager: real 0.014s user 0.000s sys 0.000s 18:16:41.409 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.409740 9863 fs_manager.cc:349] Opened local filesystem: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931400581/data 18:16:41.409 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" 18:16:41.409 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) format_stamp: "Formatted at 2017-09-20 18:16:41 on jenkins-slave-c3oe" 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.410111 9863 fs_report.cc:347] Block manager report 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) -------------------- 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) 1 data directories: /home/jenkins-slave/workspace/kudu-master/2/build/test-tmp/ts-2-1505931400581/data/data 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live blocks: 0 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes: 0 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total live bytes (after alignment): 0 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total number of LBM containers: 0 (0 full) 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for missing blocks 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Did not check for orphaned blocks 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM containers with extra space: 0 (0 repaired) 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total full LBM container extra space in bytes: 0 (0 repaired) 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total incomplete LBM containers: 0 (0 repaired) 18:16:41.410 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) Total LBM partial records: 0 (0 repaired) 18:16:41.533 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.533277 9863 ts_tablet_manager.cc:296] Loaded tablet metadata (0 live tablets) 18:16:41.536 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.535519 9863 tablet_server_main.cc:84] Starting tablet server... 18:16:41.554 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 18:16:41.807 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.807649 9649 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64038 18:16:41.807 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.807731 9649 webserver.cc:149] Starting webserver on 127.20.121.1:64039 18:16:41.808 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.807739 9649 webserver.cc:160] Document root disabled 18:16:41.808 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.807966 9649 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64039/ 18:16:41.834 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.834131 10107 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:41.834 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.834208 10107 heartbeater.cc:387] Registering TS with master... 18:16:41.834 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.834318 10107 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:41.835 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.835135 9378 ts_manager.cc:81] Registered new tserver with Master: 9d9c953c8fd2435f8c241d072f0c543a (127.20.121.1:64038) 18:16:41.835 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.835696 10118 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:41.835 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.835886 10118 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:41.836 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.836007 10118 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:41.836 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.836287 9649 tablet_server_main.cc:87] Tablet server successfully started. 18:16:41.839 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.839840 10115 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:41.840 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.839875 10115 heartbeater.cc:387] Registering TS with master... 18:16:41.840 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.839932 10115 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:41.841 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.840109 9514 ts_manager.cc:81] Registered new tserver with Master: 9d9c953c8fd2435f8c241d072f0c543a (127.20.121.1:64038) 18:16:41.841 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.841233 9514 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:56495 18:16:41.842 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.842891 10108 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:41.843 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.842916 10108 heartbeater.cc:387] Registering TS with master... 18:16:41.843 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:41.842945 10108 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:41.843 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.843228 9508 ts_manager.cc:81] Registered new tserver with Master: 9d9c953c8fd2435f8c241d072f0c543a (127.20.121.1:64038) 18:16:41.848 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.848654 9863 rpc_server.cc:192] RPC server started. Bound to: 127.20.121.1:64040 18:16:41.848 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.848732 9863 webserver.cc:149] Starting webserver on 127.20.121.1:64041 18:16:41.849 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.848739 9863 webserver.cc:160] Document root disabled 18:16:41.849 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.848953 9863 webserver.cc:282] Webserver started. Bound to: http://127.20.121.1:64041/ 18:16:41.880 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.880558 10201 process_memory.cc:180] Process hard memory limit is 94.627029 GB 18:16:41.880 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.880640 9863 tablet_server_main.cc:87] Tablet server successfully started. 18:16:41.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.880978 10201 process_memory.cc:182] Process soft memory limit is 75.701622 GB 18:16:41.881 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.881125 10201 process_memory.cc:185] Process memory pressure threshold is 56.776218 GB 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.909943 10197 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64032 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.909963 10199 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64034 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.909955 10196 heartbeater.cc:317] Connected to a master server at 127.20.121.1:64030 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.910017 10197 heartbeater.cc:387] Registering TS with master... 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.910017 10199 heartbeater.cc:387] Registering TS with master... 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.910017 10196 heartbeater.cc:387] Registering TS with master... 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.910117 10197 heartbeater.cc:414] Master 127.20.121.1:64032 requested a full tablet report, sending... 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.910122 10199 heartbeater.cc:414] Master 127.20.121.1:64034 requested a full tablet report, sending... 18:16:41.910 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:41.910117 10196 heartbeater.cc:414] Master 127.20.121.1:64030 requested a full tablet report, sending... 18:16:41.910 [INFO - kudu-master:64032] (MiniKuduCluster.java:586) I0920 18:16:41.910423 9508 ts_manager.cc:81] Registered new tserver with Master: dcdf57d4c4ea47f7ac21bfc762f488ac (127.20.121.1:64040) 18:16:41.910 [INFO - kudu-master:64030] (MiniKuduCluster.java:586) I0920 18:16:41.910423 9378 ts_manager.cc:81] Registered new tserver with Master: dcdf57d4c4ea47f7ac21bfc762f488ac (127.20.121.1:64040) 18:16:41.911 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.910356 9514 ts_manager.cc:81] Registered new tserver with Master: dcdf57d4c4ea47f7ac21bfc762f488ac (127.20.121.1:64040) 18:16:41.911 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:41.910996 9514 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:52329 18:16:42.132 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:42.132766 9514 master_service.cc:203] Signed X509 certificate for tserver {username='jenkins-slave'} at 127.20.121.1:50559 18:16:42.186 [INFO - main] (BaseKuduTest.java:117) Creating new Kudu client... 18:16:42.188 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 18:16:42.809 [INFO - main] (BaseKuduTest.java:123) Waiting for tablet servers... 18:16:42.842 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:42.842190 10115 heartbeater.cc:406] Master 127.20.121.1:64034 was elected leader, sending a full tablet report... 18:16:42.911 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:42.911665 10199 heartbeater.cc:406] Master 127.20.121.1:64034 was elected leader, sending a full tablet report... 18:16:43.034 [DEBUG - New I/O worker #131] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:43.045 [DEBUG - New I/O worker #132] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:43.046 [DEBUG - New I/O worker #133] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:43.075 [DEBUG - New I/O worker #133] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 18:16:43.076 [DEBUG - New I/O worker #133] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=66), Traces: [0ms] querying master, [10ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64030, [10ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64032, [12ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64034, [63ms] Sub rpc: ConnectToMaster received from server master-127.20.121.1:64034 response OK, null) after lookup 18:16:43.094 [DEBUG - New I/O worker #133] (Deferred.java:1330) callback=retry RPC@457914828 returned Deferred@1581888705(state=PENDING, result=null, callback=(continuation of Deferred@1432627974 after retry RPC@457914828), errback=(continuation of Deferred@1432627974 after retry RPC@457914828)), so the following Deferred is getting paused: Deferred@1432627974(state=PAUSED, result=Deferred@1581888705, callback=wakeup thread main, errback=wakeup thread main) 18:16:43.133 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.133556 9832 heartbeater.cc:406] Master 127.20.121.1:64034 was elected leader, sending a full tablet report... 18:16:43.134 [INFO - main] (BaseKuduTest.java:131) Creating table: org.apache.kudu.client.TestAsyncKuduSession-1505931385592 18:16:43.174 [DEBUG - New I/O worker #196] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:43.174 [DEBUG - New I/O worker #197] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:43.175 [DEBUG - New I/O worker #198] (Negotiator.java:384) SASL mechanism PLAIN chosen for peer 127.20.121.1 18:16:43.214 [DEBUG - New I/O worker #198] (AsyncKuduClient.java:1727) Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) 18:16:43.217 [DEBUG - New I/O worker #198] (AsyncKuduClient.java:916) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, DeadlineTracker(timeout=50000, elapsed=80), Traces: [0ms] querying master, [26ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64030, [27ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64032, [27ms] Sub rpc: ConnectToMaster sending RPC to server master-127.20.121.1:64034, [78ms] Sub rpc: ConnectToMaster received from server master-127.20.121.1:64030 response OK, [79ms] Sub rpc: ConnectToMaster received from server master-127.20.121.1:64032 response OK, [80ms] Sub rpc: ConnectToMaster received from server master-127.20.121.1:64034 response OK, null) after lookup 18:16:43.220 [DEBUG - New I/O worker #198] (Deferred.java:1330) callback=retry RPC@1568736070 returned Deferred@1887114829(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after retry RPC@1568736070), errback=(continuation of Deferred@887385023 after retry RPC@1568736070)), so the following Deferred is getting paused: Deferred@887385023(state=PAUSED, result=Deferred@1887114829, callback=org.apache.kudu.client.AsyncKuduClient$1@c81039b -> org.apache.kudu.client.AsyncKuduClient$2@59cfba7e -> wakeup thread main, errback=passthrough -> passthrough -> wakeup thread main) 18:16:43.264 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:43.264490 9514 catalog_manager.cc:1312] Servicing CreateTable request from {username='jenkins-slave'} at 127.0.0.1:59482: 18:16:43.264 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "org.apache.kudu.client.TestAsyncKuduSession-1505931385592" 18:16:43.264 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) schema { 18:16:43.264 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 18:16:43.264 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 18:16:43.264 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 18:16:43.264 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: true 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column1_i" 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column2_i" 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: INT32 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column3_s" 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: STRING 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: true 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) encoding: DICT_ENCODING 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) compression: LZ4 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 4096 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.265 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "column4_b" 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) type: BOOL 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_key: false 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) is_nullable: false 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) cfile_block_size: 0 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) partition_schema { 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) range_schema { 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) columns { 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) name: "key" 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.266 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) } 18:16:43.379 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$1@c81039b@209781659 returned Deferred@570890351(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$6@367a01be -> (continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$1@c81039b@209781659), errback=passthrough -> (continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$1@c81039b@209781659)), so the following Deferred is getting paused: Deferred@887385023(state=PAUSED, result=Deferred@570890351, callback=org.apache.kudu.client.AsyncKuduClient$2@59cfba7e -> wakeup thread main, errback=passthrough -> wakeup thread main) 18:16:43.380 [DEBUG - New I/O worker #199] (AsyncKuduClient.java:571) Opened table 8ed01bba3f9143b0b5ede244dc011e8a 18:16:43.380 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918 returned Deferred@1512046909(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918), errback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918)), so the following Deferred is getting paused: Deferred@887385023(state=PAUSED, result=Deferred@1512046909, callback=wakeup thread main, errback=wakeup thread main) 18:16:43.383 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.383513 9763 tablet_service.cc:765] Processing CreateTablet for tablet 26262d9d6c9946469705b381d1f039b2 (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=8ed01bba3f9143b0b5ede244dc011e8a]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:43.384 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081 returned Deferred@1512046909(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081), errback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081)), so the following Deferred is getting paused: Deferred@2110132733(state=PAUSED, result=Deferred@1512046909, callback=, errback=) 18:16:43.385 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.385139 9763 ts_tablet_manager.cc:1028] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Registered tablet (data state: TABLET_DATA_READY) 18:16:43.385 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.385305 10480 ts_tablet_manager.cc:878] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Bootstrapping tablet 18:16:43.385 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.385375 10480 tablet_bootstrap.cc:432] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Bootstrap starting. 18:16:43.385 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.383280 10128 tablet_service.cc:765] Processing CreateTablet for tablet 26262d9d6c9946469705b381d1f039b2 (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=8ed01bba3f9143b0b5ede244dc011e8a]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:43.385 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.385614 10128 ts_tablet_manager.cc:1028] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: Registered tablet (data state: TABLET_DATA_READY) 18:16:43.385 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.385823 10480 tablet_bootstrap.cc:567] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: No blocks or log segments found. Creating new log. 18:16:43.386 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.386060 10480 log.cc:519] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Log is configured to *not* fsync() on all Append() calls 18:16:43.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.396898 10480 tablet_bootstrap.cc:432] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: No bootstrap required, opened a new log 18:16:43.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.396975 10480 ts_tablet_manager.cc:903] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.000s 18:16:43.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.397370 10480 raft_consensus.cc:286] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d781800b71422fb6975551ca462208" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "9d9c953c8fd2435f8c241d072f0c543a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:43.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.397405 10480 raft_consensus.cc:312] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:43.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.397459 10480 raft_consensus.cc:575] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d781800b71422fb6975551ca462208, State: Initialized, Role: FOLLOWER 18:16:43.397 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.397490 10480 consensus_queue.cc:190] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:43.400 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.400545 10481 ts_tablet_manager.cc:878] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: Bootstrapping tablet 18:16:43.400 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.400657 10481 tablet_bootstrap.cc:432] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: Bootstrap starting. 18:16:43.401 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.401094 10481 tablet_bootstrap.cc:567] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: No blocks or log segments found. Creating new log. 18:16:43.401 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.401293 10481 log.cc:519] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: Log is configured to *not* fsync() on all Append() calls 18:16:43.401 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.401733 10481 tablet_bootstrap.cc:432] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: No bootstrap required, opened a new log 18:16:43.401 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.401783 10481 ts_tablet_manager.cc:903] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s 18:16:43.402 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.402101 10481 raft_consensus.cc:286] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d781800b71422fb6975551ca462208" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "9d9c953c8fd2435f8c241d072f0c543a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:43.402 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290 returned Deferred@1512046909(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290), errback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290)), so the following Deferred is getting paused: Deferred@1092897716(state=PAUSED, result=Deferred@1512046909, callback=, errback=) 18:16:43.402 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.402277 10481 raft_consensus.cc:312] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:43.402 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.402390 10481 raft_consensus.cc:575] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcdf57d4c4ea47f7ac21bfc762f488ac, State: Initialized, Role: FOLLOWER 18:16:43.402 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.402420 10481 consensus_queue.cc:190] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:43.412 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.412679 10480 ts_tablet_manager.cc:931] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Time spent starting tablet: real 0.016s user 0.000s sys 0.004s 18:16:43.412 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.412956 10481 ts_tablet_manager.cc:931] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: Time spent starting tablet: real 0.011s user 0.000s sys 0.000s 18:16:43.419 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.419106 10043 tablet_service.cc:765] Processing CreateTablet for tablet 26262d9d6c9946469705b381d1f039b2 (table=org.apache.kudu.client.TestAsyncKuduSession-1505931385592 [id=8ed01bba3f9143b0b5ede244dc011e8a]), partition=RANGE (key) PARTITION UNBOUNDED 18:16:43.421 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.421583 10043 ts_tablet_manager.cc:1028] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: Registered tablet (data state: TABLET_DATA_READY) 18:16:43.421 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.421844 10486 ts_tablet_manager.cc:878] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: Bootstrapping tablet 18:16:43.422 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.421962 10486 tablet_bootstrap.cc:432] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: Bootstrap starting. 18:16:43.422 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.422606 10486 tablet_bootstrap.cc:567] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: No blocks or log segments found. Creating new log. 18:16:43.422 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.422863 10486 log.cc:519] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: Log is configured to *not* fsync() on all Append() calls 18:16:43.422 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592 returned Deferred@1512046909(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592), errback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592)), so the following Deferred is getting paused: Deferred@777129566(state=PAUSED, result=Deferred@1512046909, callback=, errback=) 18:16:43.442 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326 returned Deferred@1512046909(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592) -> (continuation of Deferred@1794656037 after org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326), errback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592) -> (continuation of Deferred@1794656037 after org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326)), so the following Deferred is getting paused: Deferred@1794656037(state=PAUSED, result=Deferred@1512046909, callback=, errback=) 18:16:43.463 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@3c693ff8@1013530616 returned Deferred@1512046909(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592) -> (continuation of Deferred@1794656037 after org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326) -> (continuation of Deferred@49805013 after org.apache.kudu.client.AsyncKuduClient$12@3c693ff8@1013530616), errback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592) -> (continuation of Deferred@1794656037 after org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326) -> (continuation of Deferred@49805013 after org.apache.kudu.client.AsyncKuduClient$12@3c693ff8@1013530616)), so the following Deferred is getting paused: Deferred@49805013(state=PAUSED, result=Deferred@1512046909, callback=, errback=) 18:16:43.464 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.464941 10486 tablet_bootstrap.cc:432] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: No bootstrap required, opened a new log 18:16:43.465 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.465018 10486 ts_tablet_manager.cc:903] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.004s 18:16:43.465 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.465409 10486 raft_consensus.cc:286] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d781800b71422fb6975551ca462208" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "9d9c953c8fd2435f8c241d072f0c543a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:43.465 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.465452 10486 raft_consensus.cc:312] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely 18:16:43.465 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.465526 10486 raft_consensus.cc:575] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d9c953c8fd2435f8c241d072f0c543a, State: Initialized, Role: FOLLOWER 18:16:43.465 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.465561 10486 consensus_queue.cc:190] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER 18:16:43.465 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.465922 10486 ts_tablet_manager.cc:931] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s 18:16:43.503 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@1da8c239@497599033 returned Deferred@1512046909(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592) -> (continuation of Deferred@1794656037 after org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326) -> (continuation of Deferred@49805013 after org.apache.kudu.client.AsyncKuduClient$12@3c693ff8@1013530616) -> (continuation of Deferred@893484998 after org.apache.kudu.client.AsyncKuduClient$12@1da8c239@497599033), errback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592) -> (continuation of Deferred@1794656037 after org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326) -> (continuation of Deferred@49805013 after org.apache.kudu.client.AsyncKuduClient$12@3c693ff8@1013530616) -> (continuation of Deferred@893484998 after org.apache.kudu.client.AsyncKuduClient$12@1da8c239@497599033)), so the following Deferred is getting paused: Deferred@893484998(state=PAUSED, result=Deferred@1512046909, callback=, errback=) 18:16:43.503 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.503762 10483 raft_consensus.cc:411] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) 18:16:43.504 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.504009 10483 raft_consensus.cc:2455] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Snoozing failure detection for 1.871s (starting election) 18:16:43.504 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.504289 10483 raft_consensus.cc:433] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d781800b71422fb6975551ca462208" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "9d9c953c8fd2435f8c241d072f0c543a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:43.504 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.504745 10483 leader_election.cc:221] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 9d9c953c8fd2435f8c241d072f0c543a 18:16:43.505 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.504988 10483 leader_election.cc:221] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer dcdf57d4c4ea47f7ac21bfc762f488ac 18:16:43.522 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.522734 10152 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "26262d9d6c9946469705b381d1f039b2" candidate_uuid: "65d781800b71422fb6975551ca462208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" is_pre_election: true 18:16:43.523 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.522816 10152 raft_consensus.cc:2455] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: Snoozing failure detection for 1.550s (vote granted) 18:16:43.523 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.522840 10152 raft_consensus.cc:2009] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d781800b71422fb6975551ca462208 in term 0. 18:16:43.523 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.523430 9552 leader_election.cc:353] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 pre-election: Vote granted by peer dcdf57d4c4ea47f7ac21bfc762f488ac 18:16:43.523 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.523458 9552 leader_election.cc:248] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. 18:16:43.523 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.523530 10483 raft_consensus.cc:2455] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Snoozing failure detection for 1.879s (election complete) 18:16:43.523 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.523560 10483 raft_consensus.cc:2279] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 0 FOLLOWER]: Leader pre-election won for term 1 18:16:43.523 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.523574 10483 raft_consensus.cc:411] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) 18:16:43.523 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.523582 10483 raft_consensus.cc:2455] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Snoozing failure detection for 1.770s (starting election) 18:16:43.523 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.523591 10483 raft_consensus.cc:2507] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 0 FOLLOWER]: Advancing to term 1 18:16:43.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.524482 10483 raft_consensus.cc:433] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d781800b71422fb6975551ca462208" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "9d9c953c8fd2435f8c241d072f0c543a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:43.524 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.524802 10483 leader_election.cc:221] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 election: Requesting vote from peer 9d9c953c8fd2435f8c241d072f0c543a 18:16:43.525 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.525341 10063 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "26262d9d6c9946469705b381d1f039b2" candidate_uuid: "65d781800b71422fb6975551ca462208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d9c953c8fd2435f8c241d072f0c543a" is_pre_election: true 18:16:43.525 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.525367 10062 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "26262d9d6c9946469705b381d1f039b2" candidate_uuid: "65d781800b71422fb6975551ca462208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d9c953c8fd2435f8c241d072f0c543a" 18:16:43.525 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.525406 10063 raft_consensus.cc:2455] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a: Snoozing failure detection for 1.937s (vote granted) 18:16:43.525 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.525425 10063 raft_consensus.cc:2009] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d781800b71422fb6975551ca462208 in term 0. 18:16:43.525 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.525568 10062 raft_consensus.cc:1984] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [term 0 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d781800b71422fb6975551ca462208 for term 1 because replica is already servicing an update from a current leader or another vote. 18:16:43.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.525440 10483 leader_election.cc:221] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 election: Requesting vote from peer dcdf57d4c4ea47f7ac21bfc762f488ac 18:16:43.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.525696 9576 leader_election.cc:353] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 pre-election: Vote granted by peer 9d9c953c8fd2435f8c241d072f0c543a 18:16:43.525 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.525804 9576 leader_election.cc:367] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 election: Vote denied by peer 9d9c953c8fd2435f8c241d072f0c543a. Message: Service unavailable: T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [term 0 FOLLOWER]: Leader election vote request: Denying vote to candidate 65d781800b71422fb6975551ca462208 for term 1 because replica is already servicing an update from a current leader or another vote. 18:16:43.526 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.525681 10152 tablet_service.cc:1003] Received RequestConsensusVote() RPC: tablet_id: "26262d9d6c9946469705b381d1f039b2" candidate_uuid: "65d781800b71422fb6975551ca462208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" 18:16:43.526 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.525710 10152 raft_consensus.cc:2507] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac [term 0 FOLLOWER]: Advancing to term 1 18:16:43.526 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.525743 10152 raft_consensus.cc:2455] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac: Snoozing failure detection for 1.800s (vote granted) 18:16:43.526 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.526343 10152 raft_consensus.cc:2009] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d781800b71422fb6975551ca462208 in term 1. 18:16:43.526 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.526465 9552 leader_election.cc:353] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 election: Vote granted by peer dcdf57d4c4ea47f7ac21bfc762f488ac 18:16:43.526 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.526484 9552 leader_election.cc:248] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. 18:16:43.526 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.526548 10483 raft_consensus.cc:2455] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208: Snoozing failure detection for 1.818s (election complete) 18:16:43.526 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.526566 10483 raft_consensus.cc:2279] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 1 FOLLOWER]: Leader election won for term 1 18:16:43.536 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.536579 10483 raft_consensus.cc:541] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [term 1 LEADER]: Becoming Leader. State: Replica: 65d781800b71422fb6975551ca462208, State: Running, Role: LEADER 18:16:43.537 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.536988 10483 consensus_queue.cc:169] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d781800b71422fb6975551ca462208" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "9d9c953c8fd2435f8c241d072f0c543a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } 18:16:43.562 [DEBUG - New I/O worker #199] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduClient$12@40220069@1075970153 returned Deferred@1512046909(state=PENDING, result=null, callback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592) -> (continuation of Deferred@1794656037 after org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326) -> (continuation of Deferred@49805013 after org.apache.kudu.client.AsyncKuduClient$12@3c693ff8@1013530616) -> (continuation of Deferred@893484998 after org.apache.kudu.client.AsyncKuduClient$12@1da8c239@497599033) -> (continuation of Deferred@2111707110 after org.apache.kudu.client.AsyncKuduClient$12@40220069@1075970153), errback=(continuation of Deferred@887385023 after org.apache.kudu.client.AsyncKuduClient$2@59cfba7e@1506785918) -> (continuation of Deferred@2110132733 after org.apache.kudu.client.AsyncKuduClient$12@6798b901@1738062081) -> (continuation of Deferred@1092897716 after org.apache.kudu.client.AsyncKuduClient$12@1b57880a@458721290) -> (continuation of Deferred@777129566 after org.apache.kudu.client.AsyncKuduClient$12@63d6a220@1675010592) -> (continuation of Deferred@1794656037 after org.apache.kudu.client.AsyncKuduClient$12@9e2c446@165856326) -> (continuation of Deferred@49805013 after org.apache.kudu.client.AsyncKuduClient$12@3c693ff8@1013530616) -> (continuation of Deferred@893484998 after org.apache.kudu.client.AsyncKuduClient$12@1da8c239@497599033) -> (continuation of Deferred@2111707110 after org.apache.kudu.client.AsyncKuduClient$12@40220069@1075970153)), so the following Deferred is getting paused: Deferred@2111707110(state=PAUSED, result=Deferred@1512046909, callback=, errback=) 18:16:43.565 [INFO - kudu-master:64034] (MiniKuduCluster.java:586) I0920 18:16:43.565450 9514 catalog_manager.cc:2615] T 26262d9d6c9946469705b381d1f039b2 reported cstate change: term changed from 0 to 1, leader changed from to 65d781800b71422fb6975551ca462208 (127.20.121.1). New cstate: current_term: 1 leader_uuid: "65d781800b71422fb6975551ca462208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d781800b71422fb6975551ca462208" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64036 } } peers { permanent_uuid: "9d9c953c8fd2435f8c241d072f0c543a" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64038 } } peers { permanent_uuid: "dcdf57d4c4ea47f7ac21bfc762f488ac" member_type: VOTER last_known_addr { host: "127.20.121.1" port: 64040 } } } 18:16:43.701 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3b7e5627, flushNotification=Deferred@1061275024(state=PENDING, result=null, callback=, errback=)} 18:16:43.701 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@7a435c1c@2051234844 returned Deferred@41231130(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1274249757 after org.apache.kudu.client.AsyncKuduSession$1@7a435c1c@2051234844), errback=passthrough -> (continuation of Deferred@1274249757 after org.apache.kudu.client.AsyncKuduSession$1@7a435c1c@2051234844)), so the following Deferred is getting paused: Deferred@1274249757(state=PAUSED, result=Deferred@41231130, callback=, errback=) 18:16:43.702 [DEBUG - New I/O worker #199] (AsyncKuduClient.java:1727) Learned about tablet 26262d9d6c9946469705b381d1f039b2 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:43.702 [DEBUG - New I/O worker #199] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=26262d9d6c9946469705b381d1f039b2, ttl=299999}] 18:16:43.722 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) I0920 18:16:43.721945 10152 raft_consensus.cc:963] T 26262d9d6c9946469705b381d1f039b2 P dcdf57d4c4ea47f7ac21bfc762f488ac [term 1 FOLLOWER]: Refusing update from remote peer 65d781800b71422fb6975551ca462208: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 18:16:43.722 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.722576 10493 consensus_queue.cc:741] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [LEADER]: Connected to new peer: Peer: dcdf57d4c4ea47f7ac21bfc762f488ac, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:43.722 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.721951 10062 raft_consensus.cc:2507] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [term 0 FOLLOWER]: Advancing to term 1 18:16:43.722 [INFO - kudu-tserver:64038] (MiniKuduCluster.java:586) I0920 18:16:43.722784 10062 raft_consensus.cc:963] T 26262d9d6c9946469705b381d1f039b2 P 9d9c953c8fd2435f8c241d072f0c543a [term 1 FOLLOWER]: Refusing update from remote peer 65d781800b71422fb6975551ca462208: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) 18:16:43.723 [INFO - kudu-tserver:64036] (MiniKuduCluster.java:586) I0920 18:16:43.723198 10483 consensus_queue.cc:741] T 26262d9d6c9946469705b381d1f039b2 P 65d781800b71422fb6975551ca462208 [LEADER]: Connected to new peer: Peer: 9d9c953c8fd2435f8c241d072f0c543a, Is new: false, Last received: 0.0, Next index: 1, Last known committed idx: 0, Last exchange result: ERROR, Needs tablet copy: false 18:16:43.744 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 1 rows, more=false) 18:16:43.783 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:43.785 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 18:16:43.790 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 18:16:43.792 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 18:16:43.792 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=null, flushNotification=Deferred@2049942454(state=PENDING, result=null, callback=, errback=)} 18:16:43.793 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@1a6ca353@443327315 returned Deferred@833240823(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1061275024 after org.apache.kudu.client.AsyncKuduSession$1@1a6ca353@443327315), errback=passthrough -> (continuation of Deferred@1061275024 after org.apache.kudu.client.AsyncKuduSession$1@1a6ca353@443327315)), so the following Deferred is getting paused: Deferred@1061275024(state=PAUSED, result=Deferred@833240823, callback=, errback=) 18:16:43.796 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:43.848 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 0 rows, more=false) 18:16:43.850 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@669ea1b5, flushNotification=Deferred@1630244035(state=PENDING, result=null, callback=, errback=)} 18:16:43.854 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:44.861 [DEBUG - Hashed wheel timer #4] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@78236030, flushNotification=Deferred@1994686788(state=PENDING, result=null, callback=, errback=)} 18:16:44.919 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 11 rows, more=false) 18:16:44.926 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 31 rows, more=false) 18:16:44.936 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 18:16:44.939 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 30 rows, more=false) 18:16:44.939 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@505601422(state=PENDING, result=null, callback=, errback=)} 18:16:44.940 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@7e9f153b@2124354875 returned Deferred@1839169620(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1994686788 after org.apache.kudu.client.AsyncKuduSession$1@7e9f153b@2124354875), errback=passthrough -> (continuation of Deferred@1994686788 after org.apache.kudu.client.AsyncKuduSession$1@7e9f153b@2124354875)), so the following Deferred is getting paused: Deferred@1994686788(state=PAUSED, result=Deferred@1839169620, callback=, errback=) 18:16:44.964 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:44.966 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:44.967 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=20, flusherTask=null, flushNotification=Deferred@1349469360(state=PENDING, result=null, callback=, errback=)} 18:16:44.968 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@58292d9e@1479093662 returned Deferred@1587137901(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@505601422 after org.apache.kudu.client.AsyncKuduSession$1@58292d9e@1479093662), errback=passthrough -> (continuation of Deferred@505601422 after org.apache.kudu.client.AsyncKuduSession$1@58292d9e@1479093662)), so the following Deferred is getting paused: Deferred@505601422(state=PAUSED, result=Deferred@1587137901, callback=, errback=) 18:16:44.983 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:45.019 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:45.022 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4f157bca, flushNotification=Deferred@1702231132(state=PENDING, result=null, callback=, errback=)} 18:16:45.028 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@74a168b1, flushNotification=Deferred@1690509805(state=PENDING, result=null, callback=, errback=)} 18:16:45.047 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@eccd94, flushNotification=Deferred@1253136073(state=PENDING, result=null, callback=, errback=)} 18:16:45.048 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@35aa5bce@900357070 returned Deferred@1209780447(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1690509805 after org.apache.kudu.client.AsyncKuduSession$1@35aa5bce@900357070), errback=passthrough -> (continuation of Deferred@1690509805 after org.apache.kudu.client.AsyncKuduSession$1@35aa5bce@900357070)), so the following Deferred is getting paused: Deferred@1690509805(state=PAUSED, result=Deferred@1209780447, callback=, errback=) 18:16:45.052 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 21 rows, more=false) 18:16:45.053 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2e7d3c25, flushNotification=Deferred@1857691709(state=PENDING, result=null, callback=, errback=)} 18:16:45.054 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@929620f, flushNotification=Deferred@526520005(state=PENDING, result=null, callback=, errback=)} 18:16:45.055 [DEBUG - New I/O worker #200] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@15cc8dcd@365727181 returned Deferred@301145004(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1857691709 after org.apache.kudu.client.AsyncKuduSession$1@15cc8dcd@365727181), errback=passthrough -> (continuation of Deferred@1857691709 after org.apache.kudu.client.AsyncKuduSession$1@15cc8dcd@365727181)), so the following Deferred is getting paused: Deferred@1857691709(state=PAUSED, result=Deferred@301145004, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 18:16:45.057 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 18:16:45.069 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 18:16:45.129 [DEBUG - New I/O worker #199] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 18:16:45.131 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@633786888(state=PENDING, result=null, callback=, errback=)} 18:16:45.134 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2addf453, flushNotification=Deferred@1054389589(state=PENDING, result=null, callback=, errback=)} 18:16:45.142 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3602cdd9, flushNotification=Deferred@633806723(state=PENDING, result=null, callback=, errback=)} 18:16:45.154 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@60fd0804, flushNotification=Deferred@469003091(state=PENDING, result=null, callback=, errback=)} 18:16:45.188 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@993526257(state=PENDING, result=null, callback=, errback=)} 18:16:45.191 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@261e2a12, flushNotification=Deferred@774614013(state=PENDING, result=null, callback=, errback=)} 18:16:45.197 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@373158808(state=PENDING, result=null, callback=, errback=)} 18:16:45.200 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=9), No traces, null) with no deferred attached! 18:16:45.201 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1836146471(state=PENDING, result=null, callback=, errback=)} 18:16:45.202 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3a68b621, flushNotification=Deferred@1232049874(state=PENDING, result=null, callback=, errback=)} 18:16:45.212 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@817306964(state=PENDING, result=null, callback=, errback=)} 18:16:45.217 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=14), No traces, null) with no deferred attached! 18:16:45.219 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 10 rows, more=false) 18:16:45.221 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@679385462(state=PENDING, result=null, callback=, errback=)} 18:16:45.231 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1d1243ad, flushNotification=Deferred@357019878(state=PENDING, result=null, callback=, errback=)} 18:16:45.254 [DEBUG - New I/O worker #201] (AsyncKuduClient.java:1727) Learned about tablet 26262d9d6c9946469705b381d1f039b2 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:45.255 [DEBUG - New I/O worker #201] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=26262d9d6c9946469705b381d1f039b2, ttl=299999}] 18:16:45.260 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@52f2eb8, flushNotification=Deferred@1497801282(state=PENDING, result=null, callback=, errback=)} 18:16:45.260 [DEBUG - New I/O worker #201] (AsyncKuduClient.java:1727) Learned about tablet 26262d9d6c9946469705b381d1f039b2 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:45.264 [DEBUG - New I/O worker #201] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=26262d9d6c9946469705b381d1f039b2, ttl=299999}] 18:16:45.267 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@56468dec, flushNotification=Deferred@2116994882(state=PENDING, result=null, callback=, errback=)} 18:16:45.269 [DEBUG - New I/O worker #201] (AsyncKuduClient.java:1727) Learned about tablet 26262d9d6c9946469705b381d1f039b2 for table 'org.apache.kudu.client.TestAsyncKuduSession-1505931385592' with partition [, ) 18:16:45.269 [DEBUG - New I/O worker #201] (TableLocationsCache.java:184) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, tablet-id=26262d9d6c9946469705b381d1f039b2, ttl=299999}] 18:16:45.270 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2886cd1, flushNotification=Deferred@1857063536(state=PENDING, result=null, callback=, errback=)} 18:16:45.272 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@cfb43a7, flushNotification=Deferred@73892269(state=PENDING, result=null, callback=, errback=)} 18:16:45.273 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@45c89b14, flushNotification=Deferred@801204951(state=PENDING, result=null, callback=, errback=)} 18:16:45.274 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@79f1f2f3, flushNotification=Deferred@1092841097(state=PENDING, result=null, callback=, errback=)} 18:16:45.275 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@40b24d82, flushNotification=Deferred@1677791377(state=PENDING, result=null, callback=, errback=)} 18:16:45.279 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@303104136(state=PENDING, result=null, callback=, errback=)} 18:16:45.280 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@481c6365, flushNotification=Deferred@445708729(state=PENDING, result=null, callback=, errback=)} 18:16:45.282 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@76f9f7e2, flushNotification=Deferred@1828105461(state=PENDING, result=null, callback=, errback=)} 18:16:45.283 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@47daed45, flushNotification=Deferred@1520077110(state=PENDING, result=null, callback=, errback=)} 18:16:45.284 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@63652360, flushNotification=Deferred@976071421(state=PENDING, result=null, callback=, errback=)} 18:16:45.286 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2a0dd838, flushNotification=Deferred@609232758(state=PENDING, result=null, callback=, errback=)} 18:16:45.288 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6ee47ebf, flushNotification=Deferred@969497564(state=PENDING, result=null, callback=, errback=)} 18:16:45.289 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7dc198c5, flushNotification=Deferred@1477405596(state=PENDING, result=null, callback=, errback=)} 18:16:45.291 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@15d3e7a4, flushNotification=Deferred@1714899321(state=PENDING, result=null, callback=, errback=)} 18:16:45.292 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1741e2ca, flushNotification=Deferred@884025397(state=PENDING, result=null, callback=, errback=)} 18:16:45.294 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3ed507c0, flushNotification=Deferred@1660284386(state=PENDING, result=null, callback=, errback=)} 18:16:45.294 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7a3a14c4, flushNotification=Deferred@1199008566(state=PENDING, result=null, callback=, errback=)} 18:16:45.301 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1368039199(state=PENDING, result=null, callback=, errback=)} 18:16:45.302 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1c5de231, flushNotification=Deferred@913004874(state=PENDING, result=null, callback=, errback=)} 18:16:45.304 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4a39aa6a, flushNotification=Deferred@1338947157(state=PENDING, result=null, callback=, errback=)} 18:16:45.306 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3cf189f7, flushNotification=Deferred@1346123306(state=PENDING, result=null, callback=, errback=)} 18:16:45.308 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@1473363133(state=PENDING, result=null, callback=, errback=)} 18:16:45.309 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6d17d40c, flushNotification=Deferred@1570326120(state=PENDING, result=null, callback=, errback=)} 18:16:45.311 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6c25b697, flushNotification=Deferred@919325690(state=PENDING, result=null, callback=, errback=)} 18:16:45.311 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@652fce9b, flushNotification=Deferred@1922199120(state=PENDING, result=null, callback=, errback=)} 18:16:45.313 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@33c2ff9b, flushNotification=Deferred@1530816002(state=PENDING, result=null, callback=, errback=)} 18:16:45.314 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@407e30e8, flushNotification=Deferred@561981017(state=PENDING, result=null, callback=, errback=)} 18:16:45.317 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@98909130(state=PENDING, result=null, callback=, errback=)} 18:16:45.320 [DEBUG - New I/O worker #200] (KuduRpc.java:226) Handling a callback on RPC KuduRpc(method=Write, tablet=null, attempt=0, DeadlineTracker(timeout=0, elapsed=5), No traces, null) with no deferred attached! 18:16:45.320 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=null, flushNotification=Deferred@767775490(state=PENDING, result=null, callback=, errback=)} 18:16:45.322 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1c0bcf22, flushNotification=Deferred@1151237908(state=PENDING, result=null, callback=, errback=)} 18:16:45.323 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@68092726, flushNotification=Deferred@1608852070(state=PENDING, result=null, callback=, errback=)} 18:16:45.324 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1d558467, flushNotification=Deferred@713305606(state=PENDING, result=null, callback=, errback=)} 18:16:45.324 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@b150c67, flushNotification=Deferred@2106980721(state=PENDING, result=null, callback=, errback=)} 18:16:45.326 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4cd22c18, flushNotification=Deferred@1194188698(state=PENDING, result=null, callback=, errback=)} 18:16:45.327 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6478852c, flushNotification=Deferred@913618595(state=PENDING, result=null, callback=, errback=)} 18:16:45.328 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6b9bfe99, flushNotification=Deferred@1122188671(state=PENDING, result=null, callback=, errback=)} 18:16:45.329 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@629281ea, flushNotification=Deferred@1900077749(state=PENDING, result=null, callback=, errback=)} 18:16:45.330 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@451bb532, flushNotification=Deferred@508063787(state=PENDING, result=null, callback=, errback=)} 18:16:45.331 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@68233fd9, flushNotification=Deferred@503332130(state=PENDING, result=null, callback=, errback=)} 18:16:45.332 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@62ab9f5, flushNotification=Deferred@1539201075(state=PENDING, result=null, callback=, errback=)} 18:16:45.333 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2a92796a, flushNotification=Deferred@904177719(state=PENDING, result=null, callback=, errback=)} 18:16:45.334 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@66525a6f, flushNotification=Deferred@1334110550(state=PENDING, result=null, callback=, errback=)} 18:16:45.335 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@76e480e5, flushNotification=Deferred@1716595486(state=PENDING, result=null, callback=, errback=)} 18:16:45.335 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@12249499, flushNotification=Deferred@2046951890(state=PENDING, result=null, callback=, errback=)} 18:16:45.337 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@283355df, flushNotification=Deferred@1196786204(state=PENDING, result=null, callback=, errback=)} 18:16:45.338 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=1, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@71e35633, flushNotification=Deferred@453363020(state=PENDING, result=null, callback=, errback=)} 18:16:45.339 [DEBUG - New I/O worker #200] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$1@54f187f6@1425115126 returned Deferred@339509284(state=PENDING, result=null, callback=ConvertBatchToListOfResponsesCB -> (continuation of Deferred@1196786204 after org.apache.kudu.client.AsyncKuduSession$1@54f187f6@1425115126), errback=passthrough -> (continuation of Deferred@1196786204 after org.apache.kudu.client.AsyncKuduSession$1@54f187f6@1425115126)), so the following Deferred is getting paused: Deferred@1196786204(state=PAUSED, result=Deferred@339509284, callback=wakeup thread Time-limited test, errback=wakeup thread Time-limited test) 18:16:45.341 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 50 rows, more=false) 18:16:45.342 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@292ae65e, flushNotification=Deferred@1115997189(state=PENDING, result=null, callback=, errback=)} 18:16:45.344 [DEBUG - Time-limited test] (AsyncKuduSession.java:448) flushing buffer: Buffer{operations=10, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@29bd40a8, flushNotification=Deferred@472375158(state=PENDING, result=null, callback=, errback=)} 18:16:45.344 [DEBUG - Time-limited test] (Deferred.java:1330) callback=org.apache.kudu.client.AsyncKuduSession$2@6241d2ba@1648480954 returned Deferred@472375158(state=PENDING, result=null, callback=(continuation of Deferred@1115997189 after org.apache.kudu.client.AsyncKuduSession$2@6241d2ba@1648480954), errback=(continuation of Deferred@1115997189 after org.apache.kudu.client.AsyncKuduSession$2@6241d2ba@1648480954)), so the following Deferred is getting paused: Deferred@1115997189(state=PAUSED, result=Deferred@472375158, callback=, errback=) 18:16:45.347 [DEBUG - New I/O worker #200] (AsyncKuduScanner.java:886) AsyncKuduScanner$Response(scannerId="", data=RowResultIterator for 20 rows, more=false) 18:16:45.358 [DEBUG - New I/O worker #201] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 18:16:45.366 [DEBUG - New I/O worker #196] (Connection.java:666) [peer master-127.20.121.1:64030] cleaning up while in state READY due to: connection disconnected 18:16:45.372 [DEBUG - main] (Deferred.java:1330) callback=disconnect callback@1157726741 returned Deferred@1708570683(state=PENDING, result=null, callback=release resources callback -> (continuation of Deferred@225472281 after disconnect callback@1157726741), errback=passthrough -> (continuation of Deferred@225472281 after disconnect callback@1157726741)), so the following Deferred is getting paused: Deferred@225472281(state=PAUSED, result=Deferred@1708570683, callback=, errback=) 18:16:45.374 [DEBUG - New I/O worker #198] (Connection.java:666) [peer master-127.20.121.1:64034] cleaning up while in state READY due to: connection disconnected 18:16:45.374 [DEBUG - New I/O worker #200] (Connection.java:666) [peer 65d781800b71422fb6975551ca462208] cleaning up while in state READY due to: connection disconnected 18:16:45.376 [DEBUG - New I/O worker #197] (AsyncKuduClient.java:1872) Releasing all remaining resources 18:16:45.387 [DEBUG - New I/O worker #197] (Connection.java:666) [peer master-127.20.121.1:64032] cleaning up while in state READY due to: connection disconnected 18:16:45.409 [DEBUG - New I/O worker #132] (Connection.java:666) [peer master-127.20.121.1:64032] cleaning up while in state READY due to: connection disconnected 18:16:45.431 [DEBUG - New I/O worker #131] (Connection.java:666) [peer master-127.20.121.1:64030] cleaning up while in state READY due to: connection disconnected 18:16:45.433 [DEBUG - New I/O worker #134] (Connection.java:666) [peer ] cleaning up while in state READY due to: connection disconnected 18:16:45.433 [DEBUG - New I/O worker #133] (Connection.java:666) [peer master-127.20.121.1:64034] cleaning up while in state READY due to: connection disconnected 18:16:45.457 [INFO - kudu-tserver:64040] (MiniKuduCluster.java:586) *** Aborted at 1505931405 (unix time) try "date -d @1505931405" if you are using GNU date ***