Note: This is test shard 3 of 8. [==========] Running 3 tests from 3 test cases. [----------] Global test environment set-up. [----------] 1 test from MasterSentryTest [ RUN ] MasterSentryTest.TestTableOwnership Loading random data Initializing database '/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/principal' for realm 'KRBTEST.COM', master key name 'K/M@KRBTEST.COM' Apr 23 04:49:04 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): setting up network... Apr 23 04:49:04 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): listening on fd 9: udp 0.0.0.0.0 (pktinfo) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked krb5kdc: Invalid argument - Cannot request packet info for udp socket address :: port 0 Apr 23 04:49:04 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): skipping unrecognized local address family 17 Apr 23 04:49:04 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): skipping unrecognized local address family 17 Apr 23 04:49:04 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): set up 1 sockets Apr 23 04:49:04 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): commencing operation krb5kdc: starting... WARNING: Logging before InitGoogleLogging() is written to STDERR W0423 04:49:04.815057 1609 mini_kdc.cc:119] Time spent starting KDC: real 1.267s user 0.000s sys 0.005s WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "test-admin@KRBTEST.COM" created. WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "test-user@KRBTEST.COM" created. WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "joe-interloper@KRBTEST.COM" created. Authenticating as principal slave/admin@KRBTEST.COM with password. Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/test-user.keytab. Apr 23 04:49:04 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for test-admin@KRBTEST.COM: WARNING: no policy specified for hive/127.0.0.1@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "hive/127.0.0.1@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal hive/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. 2019-04-23 04:49:05: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/derby.log -Djava.security.krb5.conf=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/krb5.conf SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/apache-sentry-505b42e81a9d85c4ebe8db3f48ad7a6e824a5db5-bin/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] log4j:ERROR A "org.apache.solr.util.SolrLogLayout" object is not assignable to a "org.apache.log4j.Layout" variable. log4j:ERROR The class "org.apache.log4j.Layout" was loaded by log4j:ERROR [sun.misc.Launcher$AppClassLoader@271053e1] whereas object of type log4j:ERROR "org.apache.solr.util.SolrLogLayout" was loaded by [sun.misc.Launcher$AppClassLoader@271053e1]. Starting hive metastore on port 0 log4j:ERROR No layout set for the appender named [CONSOLE]. Apr 23 04:49:16 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994956, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Apr 23 04:49:16 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994956, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM WARNING: no policy specified for sentry/127.1.146.84@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "sentry/127.1.146.84@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Picked up JAVA_TOOL_OPTIONS: -Djava.security.krb5.conf=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/krb5.conf -Dhive.metastore.uris=thrift://127.0.0.1:42847 -Dhive.metastore.sasl.enabled=true -Dhive.metastore.kerberos.principal=hive/127.0.0.1@KRBTEST.COM SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/apache-sentry-505b42e81a9d85c4ebe8db3f48ad7a6e824a5db5-bin/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 04:49:21.557 [SENTRY - WARN - main] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored 04:49:23.193 [SENTRY - WARN - main] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt true ticketCache is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/krb5cc isInitiator false KeyTab is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab refreshKrb5Config is true principal is sentry/127.1.146.84@KRBTEST.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration Acquire TGT from Cache Principal is sentry/127.1.146.84@KRBTEST.COM null credentials from Ticket Cache principal is sentry/127.1.146.84@KRBTEST.COM Will use keytab Commit Succeeded Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt true ticketCache is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/krb5cc isInitiator true KeyTab is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab refreshKrb5Config is true principal is sentry/127.1.146.84@KRBTEST.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration Acquire TGT from Cache Principal is sentry/127.1.146.84@KRBTEST.COM null credentials from Ticket Cache Apr 23 04:49:24 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994964, etypes {rep=17 tkt=17 ses=17}, sentry/127.1.146.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM principal is sentry/127.1.146.84@KRBTEST.COM Will use keytab Commit Succeeded Apr 23 04:49:25 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994964, etypes {rep=17 tkt=17 ses=17}, sentry/127.1.146.84@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM Sentry HMS support is ready 04:49:26.508 [SENTRY - WARN - sentry-service] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored Sentry service is ready to serve client requests I0423 04:49:27.000313 1609 mini_sentry.cc:85] Time spent Starting Sentry: real 10.560s user 0.006s sys 0.029s WARNING: no policy specified for kudu/127.1.146.126@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu/127.1.146.126@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. I0423 04:49:27.025960 1609 external_mini_cluster.cc:933] Running /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.1.146.126:44903 --webserver_interface=127.1.146.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab --principal=kudu/127.1.146.126 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user --sentry_service_send_timeout_seconds=5 --sentry_service_recv_timeout_seconds=5 --trusted_user_acl=impala --user_acl=test-user,impala --sentry_privileges_cache_capacity_mb=0 --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:42847 --hive_metastore_sasl_enabled=true --sentry_service_rpc_addresses=127.1.146.84:10000 with env {KRB5CCNAME=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes} WARNING: Logging before InitGoogleLogging() is written to STDERR W0423 04:49:27.078492 1836 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0423 04:49:27.078634 1836 flags.cc:404] Enabled unsafe flag: --principal=kudu/127.1.146.126 W0423 04:49:27.078658 1836 flags.cc:404] Enabled unsafe flag: --never_fsync=true W0423 04:49:27.079649 1836 flags.cc:404] Enabled experimental flag: --hive_metastore_sasl_enabled=true W0423 04:49:27.079668 1836 flags.cc:404] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:42847 W0423 04:49:27.079674 1836 flags.cc:404] Enabled experimental flag: --trusted_user_acl=impala W0423 04:49:27.079679 1836 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 W0423 04:49:27.079689 1836 flags.cc:404] Enabled experimental flag: --sentry_service_recv_timeout_seconds=5 W0423 04:49:27.079694 1836 flags.cc:404] Enabled experimental flag: --sentry_service_rpc_addresses=127.1.146.84:10000 W0423 04:49:27.079699 1836 flags.cc:404] Enabled experimental flag: --sentry_service_send_timeout_seconds=5 W0423 04:49:27.079704 1836 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 W0423 04:49:27.079710 1836 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 W0423 04:49:27.079716 1836 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true W0423 04:49:27.079730 1836 flags.cc:404] Enabled experimental flag: --principal=kudu/127.1.146.126 I0423 04:49:27.081718 1836 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/wal --hive_metastore_sasl_enabled=true --hive_metastore_uris=thrift://127.0.0.1:42847 --trusted_user_acl=impala --ipki_ca_key_size=1024 --sentry_privileges_cache_capacity_mb=0 --sentry_service_recv_timeout_seconds=5 --sentry_service_rpc_addresses=127.1.146.84:10000 --sentry_service_send_timeout_seconds=5 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.1.146.126:44903 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab --principal=kudu/127.1.146.126 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user,impala --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/data/info.pb --webserver_interface=127.1.146.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-SNAPSHOT revision 0fbe932a3603b2016b82cf2b53ebd4aeb374ae6b build type DEBUG built by None at 23 Apr 2019 04:42:01 UTC on jenkins-slave-8qw8 build id 17242 I0423 04:49:27.086922 1836 system_ntp.cc:202] NTP initialized. Skew: 500ppm Current error: 57516us Apr 23 04:49:27 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994967, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM I0423 04:49:27.088232 1836 init.cc:359] Logged in from keytab as kudu/127.1.146.126@KRBTEST.COM (short username kudu) I0423 04:49:27.089211 1836 fs_manager.cc:263] Metadata directory not provided I0423 04:49:27.089248 1836 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0423 04:49:27.089412 1836 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0423 04:49:27.089421 1836 server_base.cc:434] Attempting to create new FS layout instead I0423 04:49:27.090930 1836 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/data/instance: uuid: "230875a846b34d84aca4e2857dc226b2" format_stamp: "Formatted at 2019-04-23 04:49:27 on dist-test-slave-dist-test-slave-rk63" I0423 04:49:27.091148 1836 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/wal/instance: uuid: "230875a846b34d84aca4e2857dc226b2" format_stamp: "Formatted at 2019-04-23 04:49:27 on dist-test-slave-dist-test-slave-rk63" I0423 04:49:27.095829 1836 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s I0423 04:49:27.096432 1836 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0423 04:49:27.096729 1836 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0423 04:49:27.099400 1836 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0423 04:49:27.099478 1836 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/data,/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/wal uuid: "230875a846b34d84aca4e2857dc226b2" format_stamp: "Formatted at 2019-04-23 04:49:27 on dist-test-slave-dist-test-slave-rk63" I0423 04:49:27.099544 1836 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0423 04:49:27.124891 1836 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0423 04:49:27.131526 1836 rpc_server.cc:205] RPC server started. Bound to: 127.1.146.126:44903 I0423 04:49:27.132118 1836 webserver.cc:308] Webserver started at http://127.1.146.126:41509/ using document root and password file I0423 04:49:27.132820 1836 server_base.cc:608] Dumped server information to /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/master-0/data/info.pb I0423 04:49:27.135232 1896 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:49:27.140123 1896 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2: Bootstrap starting. I0423 04:49:27.140213 1609 external_mini_cluster.cc:995] Started /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master as pid 1836 I0423 04:49:27.141896 1896 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2: No blocks or log segments found. Creating new log. I0423 04:49:27.142477 1896 log.cc:525] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2: Log is configured to *not* fsync() on all Append() calls I0423 04:49:27.143832 1896 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2: No bootstrap required, opened a new log WARNING: no policy specified for kudu/127.1.146.65@KRBTEST.COM; defaulting to no policy I0423 04:49:27.147044 1896 raft_consensus.cc:340] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230875a846b34d84aca4e2857dc226b2" member_type: VOTER } I0423 04:49:27.147107 1896 raft_consensus.cc:366] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:49:27.147145 1896 raft_consensus.cc:705] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230875a846b34d84aca4e2857dc226b2, State: Initialized, Role: FOLLOWER I0423 04:49:27.147477 1896 consensus_queue.cc:229] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230875a846b34d84aca4e2857dc226b2" member_type: VOTER } I0423 04:49:27.147522 1896 raft_consensus.cc:380] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:49:27.147555 1896 raft_consensus.cc:472] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:49:27.147605 1896 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 0 FOLLOWER]: Advancing to term 1 I0423 04:49:27.149150 1896 raft_consensus.cc:494] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230875a846b34d84aca4e2857dc226b2" member_type: VOTER } I0423 04:49:27.149451 1896 leader_election.cc:310] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230875a846b34d84aca4e2857dc226b2; no voters: Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu/127.1.146.65@KRBTEST.COM" created. I0423 04:49:27.149714 1896 leader_election.cc:296] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:49:27.149790 1899 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:49:27.149926 1899 raft_consensus.cc:667] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [term 1 LEADER]: Becoming Leader. State: Replica: 230875a846b34d84aca4e2857dc226b2, State: Running, Role: LEADER I0423 04:49:27.150118 1899 consensus_queue.cc:206] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230875a846b34d84aca4e2857dc226b2" member_type: VOTER } I0423 04:49:27.151006 1899 sys_catalog.cc:337] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "230875a846b34d84aca4e2857dc226b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230875a846b34d84aca4e2857dc226b2" member_type: VOTER } } I0423 04:49:27.151043 1899 sys_catalog.cc:340] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [sys.catalog]: This master's current role is: LEADER I0423 04:49:27.151233 1900 sys_catalog.cc:337] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 230875a846b34d84aca4e2857dc226b2. Latest consensus state: current_term: 1 leader_uuid: "230875a846b34d84aca4e2857dc226b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230875a846b34d84aca4e2857dc226b2" member_type: VOTER } } I0423 04:49:27.151305 1900 sys_catalog.cc:340] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [sys.catalog]: This master's current role is: LEADER I0423 04:49:27.151305 1896 sys_catalog.cc:337] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "230875a846b34d84aca4e2857dc226b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230875a846b34d84aca4e2857dc226b2" member_type: VOTER } } I0423 04:49:27.151337 1896 sys_catalog.cc:340] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [sys.catalog]: This master's current role is: LEADER I0423 04:49:27.152004 1896 sys_catalog.cc:424] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2 [sys.catalog]: configured and running, proceeding with master startup. I0423 04:49:27.152724 1904 catalog_manager.cc:1054] Loading table and tablet metadata into memory... I0423 04:49:27.155028 1904 catalog_manager.cc:1065] Initializing Kudu internal certificate authority... I0423 04:49:27.156785 1906 hms_notification_log_listener.cc:228] Skipping Hive Metastore notification log poll: Service unavailable: Leader not yet ready to serve requests Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. I0423 04:49:27.173561 1609 external_mini_cluster.cc:933] Running /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.1.146.65:0 --local_ip_for_outbound_sockets=127.1.146.65 --webserver_interface=127.1.146.65 --webserver_port=0 --tserver_master_addrs=127.1.146.126:44903 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab --principal=kudu/127.1.146.65 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user with env {KRB5CCNAME=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes} I0423 04:49:27.197996 1904 catalog_manager.cc:949] Generated new certificate authority record I0423 04:49:27.199002 1904 catalog_manager.cc:1074] Loading token signing keys... I0423 04:49:27.205690 1904 catalog_manager.cc:4279] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2: Generated new TSK 0 I0423 04:49:27.206033 1904 catalog_manager.cc:1085] Loading latest processed Hive Metastore notification log event ID... WARNING: Logging before InitGoogleLogging() is written to STDERR W0423 04:49:27.238344 1911 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0423 04:49:27.238500 1911 flags.cc:404] Enabled unsafe flag: --principal=kudu/127.1.146.65 W0423 04:49:27.238544 1911 flags.cc:404] Enabled unsafe flag: --never_fsync=true W0423 04:49:27.239749 1911 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 W0423 04:49:27.239789 1911 flags.cc:404] Enabled experimental flag: --principal=kudu/127.1.146.65 W0423 04:49:27.239852 1911 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.146.65 I0423 04:49:27.242166 1911 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.1.146.65:0 --rpc_server_allow_ephemeral_ports=true --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab --principal=kudu/127.1.146.65 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/data/info.pb --webserver_interface=127.1.146.65 --webserver_port=0 --tserver_master_addrs=127.1.146.126:44903 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.1.146.65 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-SNAPSHOT revision 0fbe932a3603b2016b82cf2b53ebd4aeb374ae6b build type DEBUG built by None at 23 Apr 2019 04:42:01 UTC on jenkins-slave-8qw8 build id 17242 I0423 04:49:27.248694 1911 system_ntp.cc:202] NTP initialized. Skew: 500ppm Current error: 57516us Apr 23 04:49:27 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994967, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM I0423 04:49:27.250138 1911 init.cc:359] Logged in from keytab as kudu/127.1.146.65@KRBTEST.COM (short username kudu) I0423 04:49:27.250979 1911 fs_manager.cc:263] Metadata directory not provided I0423 04:49:27.251019 1911 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0423 04:49:27.251215 1911 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0423 04:49:27.251238 1911 server_base.cc:434] Attempting to create new FS layout instead I0423 04:49:27.253124 1911 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/data/instance: uuid: "309351a000f74924b9ac8e3a5db0ba5e" format_stamp: "Formatted at 2019-04-23 04:49:27 on dist-test-slave-dist-test-slave-rk63" I0423 04:49:27.253397 1911 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/wal/instance: uuid: "309351a000f74924b9ac8e3a5db0ba5e" format_stamp: "Formatted at 2019-04-23 04:49:27 on dist-test-slave-dist-test-slave-rk63" I0423 04:49:27.261090 1911 fs_manager.cc:503] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s I0423 04:49:27.261647 1911 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0423 04:49:27.261939 1911 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0423 04:49:27.264617 1911 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0423 04:49:27.264704 1911 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/data,/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/wal uuid: "309351a000f74924b9ac8e3a5db0ba5e" format_stamp: "Formatted at 2019-04-23 04:49:27 on dist-test-slave-dist-test-slave-rk63" I0423 04:49:27.264783 1911 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0423 04:49:27.300333 1911 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0423 04:49:27.301177 1911 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0423 04:49:27.301206 1911 ts_tablet_manager.cc:376] Registered 0 tablets I0423 04:49:27.307703 1911 rpc_server.cc:205] RPC server started. Bound to: 127.1.146.65:34831 I0423 04:49:27.308281 1911 webserver.cc:308] Webserver started at http://127.1.146.65:39121/ using document root and password file I0423 04:49:27.309187 1911 server_base.cc:608] Dumped server information to /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/data/info.pb Apr 23 04:49:27 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994967, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.65@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM I0423 04:49:27.319447 1609 external_mini_cluster.cc:995] Started /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver as pid 1911 I0423 04:49:27.323740 2032 heartbeater.cc:345] Connected to a master server at 127.1.146.126:44903 I0423 04:49:27.323845 2032 heartbeater.cc:426] Registering TS with master... I0423 04:49:27.324124 2032 heartbeater.cc:475] Master 127.1.146.126:44903 requested a full tablet report, sending... I0423 04:49:27.325237 1863 ts_manager.cc:159] Registered new tserver with Master: 309351a000f74924b9ac8e3a5db0ba5e (127.1.146.65:34831) I0423 04:49:27.326313 1863 master_service.cc:271] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.146.65@KRBTEST.COM'} at 127.1.146.65:48337 Apr 23 04:49:27 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM I0423 04:49:27.335243 1609 external_mini_cluster.cc:623] 1 TS(s) registered with all masters WARNING: no policy specified for impala@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "impala@KRBTEST.COM" created. WARNING: no policy specified for kudu@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu@KRBTEST.COM" created. Apr 23 04:49:27 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994967, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for kudu@KRBTEST.COM: Apr 23 04:49:27 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994967, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM Apr 23 04:49:27 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994967, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM I0423 04:49:28.328003 2032 heartbeater.cc:467] Master 127.1.146.126:44903 was elected leader, sending a full tablet report... W0423 04:49:28.599891 1609 sentry_client.cc:152] Time spent create Sentry role: real 1.078s user 0.000s sys 0.000s Apr 23 04:49:29 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994956, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM 04:49:29.598 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:250) Create database event has incomplete information. dbName: db location: null Apr 23 04:49:29 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994967, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM I0423 04:49:29.758278 1863 catalog_manager.cc:1414] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44806: name: "db.table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 0 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 0 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } Apr 23 04:49:29 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994967, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM 04:49:30.198 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:250) Create database event has incomplete information. dbName: db location: null 04:49:30.563 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:250) Create database event has incomplete information. dbName: db location: null 04:49:30.577 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = table, location = null I0423 04:49:30.642506 1969 tablet_service.cc:1017] Processing CreateTablet for tablet d942ce36fda44af8ab8eb744bb2971ca (table=db.table [id=dca539cc50c5495986240171585884ab]), partition=RANGE (key) PARTITION UNBOUNDED I0423 04:49:30.643035 1969 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d942ce36fda44af8ab8eb744bb2971ca. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:49:30.648874 2080 tablet_bootstrap.cc:439] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e: Bootstrap starting. I0423 04:49:30.651134 2080 tablet_bootstrap.cc:590] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e: No blocks or log segments found. Creating new log. I0423 04:49:30.651883 2080 log.cc:525] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e: Log is configured to *not* fsync() on all Append() calls I0423 04:49:30.652899 2080 tablet_bootstrap.cc:439] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e: No bootstrap required, opened a new log I0423 04:49:30.653054 2080 ts_tablet_manager.cc:1053] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0423 04:49:30.655905 2080 raft_consensus.cc:340] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:30.656036 2080 raft_consensus.cc:366] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:49:30.656144 2080 raft_consensus.cc:705] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 309351a000f74924b9ac8e3a5db0ba5e, State: Initialized, Role: FOLLOWER I0423 04:49:30.656633 2080 consensus_queue.cc:229] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:30.656699 2080 raft_consensus.cc:380] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:49:30.656756 2080 raft_consensus.cc:472] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:49:30.656822 2080 raft_consensus.cc:2886] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Advancing to term 1 I0423 04:49:30.657538 2080 raft_consensus.cc:494] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:30.657876 2080 leader_election.cc:310] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 309351a000f74924b9ac8e3a5db0ba5e; no voters: I0423 04:49:30.658231 2080 leader_election.cc:296] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:49:30.658818 2080 ts_tablet_manager.cc:1081] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s I0423 04:49:30.658988 2082 raft_consensus.cc:2640] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:49:30.659294 2082 raft_consensus.cc:667] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [term 1 LEADER]: Becoming Leader. State: Replica: 309351a000f74924b9ac8e3a5db0ba5e, State: Running, Role: LEADER I0423 04:49:30.659590 2082 consensus_queue.cc:206] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:30.661736 1862 catalog_manager.cc:3975] T d942ce36fda44af8ab8eb744bb2971ca P 309351a000f74924b9ac8e3a5db0ba5e reported cstate change: term changed from 0 to 1, leader changed from to 309351a000f74924b9ac8e3a5db0ba5e (127.1.146.65). New cstate: current_term: 1 leader_uuid: "309351a000f74924b9ac8e3a5db0ba5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } health_report { overall_health: HEALTHY } } } I0423 04:49:30.724232 1863 catalog_manager.cc:1414] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44806: name: "db.second_table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 0 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 0 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } 04:49:31.062 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = table, location = null 04:49:31.066 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null I0423 04:49:31.086418 1969 tablet_service.cc:1017] Processing CreateTablet for tablet 7ad2cdbeb37043789bbdf51a8aaebc06 (table=db.second_table [id=97f65b2d51e64cfdb4504cfbf21d174f]), partition=RANGE (key) PARTITION UNBOUNDED I0423 04:49:31.086668 1969 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 7ad2cdbeb37043789bbdf51a8aaebc06. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:49:31.088996 2080 tablet_bootstrap.cc:439] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e: Bootstrap starting. I0423 04:49:31.089829 2080 tablet_bootstrap.cc:590] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e: No blocks or log segments found. Creating new log. I0423 04:49:31.096549 2080 tablet_bootstrap.cc:439] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e: No bootstrap required, opened a new log I0423 04:49:31.096660 2080 ts_tablet_manager.cc:1053] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s I0423 04:49:31.097249 2080 raft_consensus.cc:340] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:31.097291 2080 raft_consensus.cc:366] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:49:31.097308 2080 raft_consensus.cc:705] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 309351a000f74924b9ac8e3a5db0ba5e, State: Initialized, Role: FOLLOWER I0423 04:49:31.097447 2080 consensus_queue.cc:229] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:31.097491 2080 raft_consensus.cc:380] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:49:31.097506 2080 raft_consensus.cc:472] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:49:31.097543 2080 raft_consensus.cc:2886] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Advancing to term 1 I0423 04:49:31.098433 2080 raft_consensus.cc:494] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:31.098554 2080 leader_election.cc:310] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 309351a000f74924b9ac8e3a5db0ba5e; no voters: I0423 04:49:31.098697 2080 leader_election.cc:296] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:49:31.098795 2082 raft_consensus.cc:2640] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:49:31.098932 2080 ts_tablet_manager.cc:1081] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s I0423 04:49:31.099078 2082 raft_consensus.cc:667] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [term 1 LEADER]: Becoming Leader. State: Replica: 309351a000f74924b9ac8e3a5db0ba5e, State: Running, Role: LEADER I0423 04:49:31.099205 2082 consensus_queue.cc:206] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:31.100397 1862 catalog_manager.cc:3975] T 7ad2cdbeb37043789bbdf51a8aaebc06 P 309351a000f74924b9ac8e3a5db0ba5e reported cstate change: term changed from 0 to 1, leader changed from to 309351a000f74924b9ac8e3a5db0ba5e (127.1.146.65). New cstate: current_term: 1 leader_uuid: "309351a000f74924b9ac8e3a5db0ba5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } health_report { overall_health: HEALTHY } } } Apr 23 04:49:31 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994971, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for test-user@KRBTEST.COM: Apr 23 04:49:31 dist-test-slave-dist-test-slave-rk63 krb5kdc[1616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994971, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM I0423 04:49:31.335464 1863 catalog_manager.cc:1414] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44822: name: "db.new_table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 0 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 0 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } 04:49:31.562 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null 04:49:31.567 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null I0423 04:49:31.590263 1969 tablet_service.cc:1017] Processing CreateTablet for tablet c32e404f45f047879783e814d9f1b93b (table=db.new_table [id=2b7481c7b5554335845ac0d96ab1664c]), partition=RANGE (key) PARTITION UNBOUNDED I0423 04:49:31.590509 1969 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c32e404f45f047879783e814d9f1b93b. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:49:31.592886 2080 tablet_bootstrap.cc:439] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: Bootstrap starting. I0423 04:49:31.593814 2080 tablet_bootstrap.cc:590] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: No blocks or log segments found. Creating new log. I0423 04:49:31.595676 2080 tablet_bootstrap.cc:439] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: No bootstrap required, opened a new log I0423 04:49:31.595767 2080 ts_tablet_manager.cc:1053] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s I0423 04:49:31.596216 2080 raft_consensus.cc:340] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:31.596252 2080 raft_consensus.cc:366] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:49:31.596268 2080 raft_consensus.cc:705] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 309351a000f74924b9ac8e3a5db0ba5e, State: Initialized, Role: FOLLOWER I0423 04:49:31.596397 2080 consensus_queue.cc:229] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:31.596429 2080 raft_consensus.cc:380] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:49:31.596442 2080 raft_consensus.cc:472] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:49:31.596468 2080 raft_consensus.cc:2886] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 0 FOLLOWER]: Advancing to term 1 I0423 04:49:31.597534 2080 raft_consensus.cc:494] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:31.597637 2080 leader_election.cc:310] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 309351a000f74924b9ac8e3a5db0ba5e; no voters: I0423 04:49:31.597738 2080 leader_election.cc:296] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:49:31.597816 2082 raft_consensus.cc:2640] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:49:31.597957 2082 raft_consensus.cc:667] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 1 LEADER]: Becoming Leader. State: Replica: 309351a000f74924b9ac8e3a5db0ba5e, State: Running, Role: LEADER I0423 04:49:31.598093 2082 consensus_queue.cc:206] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } } I0423 04:49:31.598629 2080 ts_tablet_manager.cc:1081] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s I0423 04:49:31.599371 1862 catalog_manager.cc:3975] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e reported cstate change: term changed from 0 to 1, leader changed from to 309351a000f74924b9ac8e3a5db0ba5e (127.1.146.65). New cstate: current_term: 1 leader_uuid: "309351a000f74924b9ac8e3a5db0ba5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309351a000f74924b9ac8e3a5db0ba5e" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34831 } health_report { overall_health: HEALTHY } } } I0423 04:49:31.662328 1863 catalog_manager.cc:1888] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44822: table { table_name: "db.new_table" } modify_external_catalogs: true 04:49:32.062 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:32.563 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:33.062 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:34.364 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:35.502 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:37.414 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:38.221 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:38.473 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:38.762 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:38.951 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:39.275 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:39.359 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:39.373 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:39.397 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:39.409 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:39.565 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:40.063 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:40.561 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:41.072 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:41.561 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null W0423 04:49:41.662981 2099 master_proxy_rpc.cc:192] Re-attempting DeleteTable request to leader Master (127.1.146.126:44903) I0423 04:49:41.680341 1862 catalog_manager.cc:1888] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44822: table { table_name: "db.new_table" } modify_external_catalogs: true 04:49:42.063 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:42.562 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:43.068 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null 04:49:43.563 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = new_table, location = null W0423 04:49:43.734222 1905 hms_client.cc:265] Time spent drop HMS table: real 12.044s user 0.000s sys 0.000s W0423 04:49:43.734884 1863 rpcz_store.cc:253] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44822 (request call id 5) took 12072 ms (12.1 s). Client timeout 9999 ms (10 s) W0423 04:49:43.735288 1863 rpcz_store.cc:259] Trace: 0423 04:49:31.661937 (+ 0us) service_pool.cc:162] Inserting onto call queue 0423 04:49:31.662021 (+ 84us) service_pool.cc:221] Handling call 0423 04:49:31.666981 (+ 4960us) catalog_manager.cc:1784] Looking up, locking, and authorizing table 0423 04:49:43.734812 (+12067831us) inbound_call.cc:162] Queueing success response Metrics: {"Hive Metastore.queue_time_us":53,"Hive Metastore.run_cpu_time_us":436,"Hive Metastore.run_wall_time_us":12044352,"Sentry.queue_time_us":42,"Sentry.run_cpu_time_us":342,"Sentry.run_wall_time_us":22436} I0423 04:49:43.738297 1906 catalog_manager.cc:1942] Deleting table db.new_table [id=2b7481c7b5554335845ac0d96ab1664c] in response to Hive Metastore notification log event 5 I0423 04:49:43.753437 1906 catalog_manager.cc:4214] T 00000000000000000000000000000000 P 230875a846b34d84aca4e2857dc226b2: Sending DeleteTablet for 1 replicas of tablet c32e404f45f047879783e814d9f1b93b I0423 04:49:43.753602 1906 catalog_manager.cc:3377] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet c32e404f45f047879783e814d9f1b93b on 309351a000f74924b9ac8e3a5db0ba5e (127.1.146.65:34831) (Table deleted at 2019-04-23 04:49:43 UTC) I0423 04:49:43.754462 1969 tablet_service.cc:1058] Processing DeleteTablet for tablet c32e404f45f047879783e814d9f1b93b with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-23 04:49:43 UTC) from {username='kudu', principal='kudu/127.1.146.126@KRBTEST.COM'} at 127.0.0.1:47004 I0423 04:49:43.755393 2115 tablet_replica.cc:264] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: stopping tablet replica I0423 04:49:43.756644 2115 raft_consensus.cc:2143] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 1 LEADER]: Raft consensus shutting down. I0423 04:49:43.756878 2115 raft_consensus.cc:2170] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e [term 1 FOLLOWER]: Raft consensus is shut down! I0423 04:49:43.758298 2115 ts_tablet_manager.cc:1377] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: Deleting tablet data with delete state TABLET_DATA_DELETED I0423 04:49:43.761842 2115 ts_tablet_manager.cc:1390] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1 I0423 04:49:43.761965 2115 log.cc:990] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: Deleting WAL directory at /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609/minicluster-data/ts-0/wal/wals/c32e404f45f047879783e814d9f1b93b I0423 04:49:43.762322 2115 ts_tablet_manager.cc:1411] T c32e404f45f047879783e814d9f1b93b P 309351a000f74924b9ac8e3a5db0ba5e: Deleting consensus metadata I0423 04:49:43.764319 1847 catalog_manager.cc:3355] TS 309351a000f74924b9ac8e3a5db0ba5e (127.1.146.65:34831): tablet c32e404f45f047879783e814d9f1b93b (table db.new_table [id=2b7481c7b5554335845ac0d96ab1664c]) successfully deleted W0423 04:49:43.773183 1862 sentry_authz_provider.cc:269] Action on table with authorizable scope is not permitted for user I0423 04:49:43.773447 1862 rpcz_store.cc:269] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:44822 (request call id 6) took 2093ms. Request Metrics: {"Sentry.queue_time_us":33,"Sentry.run_cpu_time_us":390,"Sentry.run_wall_time_us":18856} /home/jenkins-slave/workspace/kudu-master/1/src/kudu/integration-tests/master_sentry-itest.cc:446: Failure Failed Bad status: Not authorized: unauthorized action I0423 04:49:43.774983 1609 external_mini_cluster-itest-base.cc:80] Found fatal failure I0423 04:49:43.775054 1609 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID 309351a000f74924b9ac8e3a5db0ba5e and pid 1911 ************************ BEGIN STACKS ************************** 0x00007fe6678fbd4d in ?? () Id Target Id Frame * 1 process 1911 "kudu-tserver" 0x00007fe6678fbd4d in ?? () Thread 1 (process 1911): #0 0x00007fe6678fbd4d in ?? () #1 0x0000000000000000 in ?? () ************************* END STACKS *************************** I0423 04:49:43.993522 1609 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver with pid 1911 I0423 04:49:43.997261 1609 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master with pid 1836 [Krb5LoginModule]: Entering logout [Krb5LoginModule]: logged out Subject 04:49:44.012 [SENTRY - ERROR - service-shutdown] (SentryService.java:603) Error stopping SentryService java.lang.NullPointerException at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:187) at org.apache.sentry.service.thrift.SentryService.stopSentryStoreCleaner(SentryService.java:425) at org.apache.sentry.service.thrift.SentryService.stop(SentryService.java:504) at org.apache.sentry.service.thrift.SentryService$CommandImpl$1.run(SentryService.java:601) at java.lang.Thread.run(Thread.java:748) Shutting down hive metastore. I0423 04:49:49.522655 1609 test_util.cc:135] ----------------------------------------------- I0423 04:49:49.522692 1609 test_util.cc:136] Had fatal failures, leaving test files at /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.MasterSentryTest.TestTableOwnership.1555994943536608-1609 [ FAILED ] MasterSentryTest.TestTableOwnership (45982 ms) [----------] 1 test from MasterSentryTest (45982 ms total) [----------] 1 test from AuthzCombinations/TestAuthzTable [ RUN ] AuthzCombinations/TestAuthzTable.TestAuthorizeTable/5 Loading random data Initializing database '/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/principal' for realm 'KRBTEST.COM', master key name 'K/M@KRBTEST.COM' Apr 23 04:49:49 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): setting up network... Apr 23 04:49:49 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): listening on fd 9: udp 0.0.0.0.0 (pktinfo) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked krb5kdc: Invalid argument - Cannot request packet info for udp socket address :: port 0 Apr 23 04:49:49 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): skipping unrecognized local address family 17 Apr 23 04:49:49 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): skipping unrecognized local address family 17 Apr 23 04:49:49 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): set up 1 sockets Apr 23 04:49:49 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): commencing operation krb5kdc: starting... W0423 04:49:49.891819 1609 mini_kdc.cc:119] Time spent starting KDC: real 0.368s user 0.000s sys 0.005s WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "test-admin@KRBTEST.COM" created. WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "test-user@KRBTEST.COM" created. WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "joe-interloper@KRBTEST.COM" created. Authenticating as principal slave/admin@KRBTEST.COM with password. Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/test-user.keytab. Apr 23 04:49:49 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for test-admin@KRBTEST.COM: WARNING: no policy specified for hive/127.0.0.1@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "hive/127.0.0.1@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal hive/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. 2019-04-23 04:49:50: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/derby.log -Djava.security.krb5.conf=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/krb5.conf SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/apache-sentry-505b42e81a9d85c4ebe8db3f48ad7a6e824a5db5-bin/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] log4j:ERROR A "org.apache.solr.util.SolrLogLayout" object is not assignable to a "org.apache.log4j.Layout" variable. log4j:ERROR The class "org.apache.log4j.Layout" was loaded by log4j:ERROR [sun.misc.Launcher$AppClassLoader@271053e1] whereas object of type log4j:ERROR "org.apache.solr.util.SolrLogLayout" was loaded by [sun.misc.Launcher$AppClassLoader@271053e1]. Starting hive metastore on port 0 log4j:ERROR No layout set for the appender named [CONSOLE]. Apr 23 04:50:00 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995000, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Apr 23 04:50:00 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995000, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM WARNING: no policy specified for sentry/127.1.146.84@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "sentry/127.1.146.84@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Picked up JAVA_TOOL_OPTIONS: -Djava.security.krb5.conf=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/krb5.conf -Dhive.metastore.uris=thrift://127.0.0.1:46711 -Dhive.metastore.sasl.enabled=true -Dhive.metastore.kerberos.principal=hive/127.0.0.1@KRBTEST.COM SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/apache-sentry-505b42e81a9d85c4ebe8db3f48ad7a6e824a5db5-bin/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 04:50:06.364 [SENTRY - WARN - main] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored 04:50:08.073 [SENTRY - WARN - main] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt true ticketCache is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/krb5cc isInitiator false KeyTab is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab refreshKrb5Config is true principal is sentry/127.1.146.84@KRBTEST.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration Acquire TGT from Cache Principal is sentry/127.1.146.84@KRBTEST.COM null credentials from Ticket Cache principal is sentry/127.1.146.84@KRBTEST.COM Will use keytab Commit Succeeded Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt true ticketCache is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/krb5cc isInitiator true KeyTab is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab refreshKrb5Config is true principal is sentry/127.1.146.84@KRBTEST.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration Acquire TGT from Cache Principal is sentry/127.1.146.84@KRBTEST.COM null credentials from Ticket Cache Apr 23 04:50:09 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995009, etypes {rep=17 tkt=17 ses=17}, sentry/127.1.146.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM principal is sentry/127.1.146.84@KRBTEST.COM Will use keytab Commit Succeeded Apr 23 04:50:10 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995009, etypes {rep=17 tkt=17 ses=17}, sentry/127.1.146.84@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM Sentry HMS support is ready 04:50:11.039 [SENTRY - WARN - sentry-service] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored Sentry service is ready to serve client requests I0423 04:50:11.548079 1609 mini_sentry.cc:85] Time spent Starting Sentry: real 10.499s user 0.016s sys 0.022s WARNING: no policy specified for kudu/127.1.146.126@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu/127.1.146.126@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. I0423 04:50:11.572535 1609 external_mini_cluster.cc:933] Running /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.1.146.126:37371 --webserver_interface=127.1.146.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab --principal=kudu/127.1.146.126 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user --sentry_service_send_timeout_seconds=5 --sentry_service_recv_timeout_seconds=5 --trusted_user_acl=impala --user_acl=test-user,impala --sentry_privileges_cache_capacity_mb=0 --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:46711 --hive_metastore_sasl_enabled=true --sentry_service_rpc_addresses=127.1.146.84:10000 with env {KRB5CCNAME=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes} WARNING: Logging before InitGoogleLogging() is written to STDERR W0423 04:50:11.624994 2353 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0423 04:50:11.625133 2353 flags.cc:404] Enabled unsafe flag: --principal=kudu/127.1.146.126 W0423 04:50:11.625159 2353 flags.cc:404] Enabled unsafe flag: --never_fsync=true W0423 04:50:11.626201 2353 flags.cc:404] Enabled experimental flag: --hive_metastore_sasl_enabled=true W0423 04:50:11.626219 2353 flags.cc:404] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:46711 W0423 04:50:11.626224 2353 flags.cc:404] Enabled experimental flag: --trusted_user_acl=impala W0423 04:50:11.626230 2353 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 W0423 04:50:11.626238 2353 flags.cc:404] Enabled experimental flag: --sentry_service_recv_timeout_seconds=5 W0423 04:50:11.626245 2353 flags.cc:404] Enabled experimental flag: --sentry_service_rpc_addresses=127.1.146.84:10000 W0423 04:50:11.626252 2353 flags.cc:404] Enabled experimental flag: --sentry_service_send_timeout_seconds=5 W0423 04:50:11.626262 2353 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 W0423 04:50:11.626325 2353 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 W0423 04:50:11.626336 2353 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true W0423 04:50:11.626356 2353 flags.cc:404] Enabled experimental flag: --principal=kudu/127.1.146.126 I0423 04:50:11.628322 2353 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/wal --hive_metastore_sasl_enabled=true --hive_metastore_uris=thrift://127.0.0.1:46711 --trusted_user_acl=impala --ipki_ca_key_size=1024 --sentry_privileges_cache_capacity_mb=0 --sentry_service_recv_timeout_seconds=5 --sentry_service_rpc_addresses=127.1.146.84:10000 --sentry_service_send_timeout_seconds=5 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.1.146.126:37371 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab --principal=kudu/127.1.146.126 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user,impala --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/data/info.pb --webserver_interface=127.1.146.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-SNAPSHOT revision 0fbe932a3603b2016b82cf2b53ebd4aeb374ae6b build type DEBUG built by None at 23 Apr 2019 04:42:01 UTC on jenkins-slave-8qw8 build id 17242 I0423 04:50:11.633533 2353 system_ntp.cc:202] NTP initialized. Skew: 500ppm Current error: 79516us Apr 23 04:50:11 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM I0423 04:50:11.634855 2353 init.cc:359] Logged in from keytab as kudu/127.1.146.126@KRBTEST.COM (short username kudu) I0423 04:50:11.635697 2353 fs_manager.cc:263] Metadata directory not provided I0423 04:50:11.635736 2353 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0423 04:50:11.635929 2353 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0423 04:50:11.635951 2353 server_base.cc:434] Attempting to create new FS layout instead I0423 04:50:11.637637 2353 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/data/instance: uuid: "4c10082e67804da59ca55b2fd3ac0e33" format_stamp: "Formatted at 2019-04-23 04:50:11 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:11.637892 2353 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/wal/instance: uuid: "4c10082e67804da59ca55b2fd3ac0e33" format_stamp: "Formatted at 2019-04-23 04:50:11 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:11.642009 2353 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s I0423 04:50:11.642539 2353 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0423 04:50:11.642799 2353 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0423 04:50:11.645417 2353 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0423 04:50:11.645490 2353 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/data,/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/wal uuid: "4c10082e67804da59ca55b2fd3ac0e33" format_stamp: "Formatted at 2019-04-23 04:50:11 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:11.645565 2353 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0423 04:50:11.690853 2353 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0423 04:50:11.695410 2353 rpc_server.cc:205] RPC server started. Bound to: 127.1.146.126:37371 I0423 04:50:11.696022 2353 webserver.cc:308] Webserver started at http://127.1.146.126:41649/ using document root and password file I0423 04:50:11.696552 2353 server_base.cc:608] Dumped server information to /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/master-0/data/info.pb I0423 04:50:11.699237 2413 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:50:11.703927 2413 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33: Bootstrap starting. I0423 04:50:11.705801 2413 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33: No blocks or log segments found. Creating new log. I0423 04:50:11.706430 2413 log.cc:525] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33: Log is configured to *not* fsync() on all Append() calls I0423 04:50:11.706564 1609 external_mini_cluster.cc:995] Started /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master as pid 2353 I0423 04:50:11.707294 2413 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33: No bootstrap required, opened a new log I0423 04:50:11.710129 2413 raft_consensus.cc:340] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c10082e67804da59ca55b2fd3ac0e33" member_type: VOTER } I0423 04:50:11.710182 2413 raft_consensus.cc:366] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:50:11.710211 2413 raft_consensus.cc:705] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c10082e67804da59ca55b2fd3ac0e33, State: Initialized, Role: FOLLOWER I0423 04:50:11.710582 2413 consensus_queue.cc:229] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c10082e67804da59ca55b2fd3ac0e33" member_type: VOTER } I0423 04:50:11.710634 2413 raft_consensus.cc:380] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:50:11.710661 2413 raft_consensus.cc:472] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:50:11.710718 2413 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 0 FOLLOWER]: Advancing to term 1 I0423 04:50:11.711386 2413 raft_consensus.cc:494] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c10082e67804da59ca55b2fd3ac0e33" member_type: VOTER } I0423 04:50:11.711673 2413 leader_election.cc:310] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c10082e67804da59ca55b2fd3ac0e33; no voters: I0423 04:50:11.711931 2413 leader_election.cc:296] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:50:11.712018 2416 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:50:11.712139 2416 raft_consensus.cc:667] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [term 1 LEADER]: Becoming Leader. State: Replica: 4c10082e67804da59ca55b2fd3ac0e33, State: Running, Role: LEADER I0423 04:50:11.712357 2416 consensus_queue.cc:206] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c10082e67804da59ca55b2fd3ac0e33" member_type: VOTER } WARNING: no policy specified for kudu/127.1.146.65@KRBTEST.COM; defaulting to no policy I0423 04:50:11.713631 2417 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c10082e67804da59ca55b2fd3ac0e33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c10082e67804da59ca55b2fd3ac0e33" member_type: VOTER } } I0423 04:50:11.713703 2417 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [sys.catalog]: This master's current role is: LEADER I0423 04:50:11.713650 2418 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c10082e67804da59ca55b2fd3ac0e33. Latest consensus state: current_term: 1 leader_uuid: "4c10082e67804da59ca55b2fd3ac0e33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c10082e67804da59ca55b2fd3ac0e33" member_type: VOTER } } I0423 04:50:11.713896 2418 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [sys.catalog]: This master's current role is: LEADER I0423 04:50:11.713991 2413 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "4c10082e67804da59ca55b2fd3ac0e33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c10082e67804da59ca55b2fd3ac0e33" member_type: VOTER } } I0423 04:50:11.714013 2413 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [sys.catalog]: This master's current role is: LEADER Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu/127.1.146.65@KRBTEST.COM" created. I0423 04:50:11.715164 2413 sys_catalog.cc:424] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33 [sys.catalog]: configured and running, proceeding with master startup. I0423 04:50:11.715245 2420 catalog_manager.cc:1054] Loading table and tablet metadata into memory... I0423 04:50:11.719209 2420 catalog_manager.cc:1065] Initializing Kudu internal certificate authority... I0423 04:50:11.737815 2420 catalog_manager.cc:949] Generated new certificate authority record Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. I0423 04:50:11.738970 1609 external_mini_cluster.cc:933] Running /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.1.146.65:0 --local_ip_for_outbound_sockets=127.1.146.65 --webserver_interface=127.1.146.65 --webserver_port=0 --tserver_master_addrs=127.1.146.126:37371 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab --principal=kudu/127.1.146.65 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user with env {KRB5CCNAME=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes} I0423 04:50:11.739001 2420 catalog_manager.cc:1074] Loading token signing keys... I0423 04:50:11.744624 2420 catalog_manager.cc:4279] T 00000000000000000000000000000000 P 4c10082e67804da59ca55b2fd3ac0e33: Generated new TSK 0 Apr 23 04:50:11 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM WARNING: Logging before InitGoogleLogging() is written to STDERR W0423 04:50:11.793783 2425 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0423 04:50:11.794055 2425 flags.cc:404] Enabled unsafe flag: --principal=kudu/127.1.146.65 W0423 04:50:11.794147 2425 flags.cc:404] Enabled unsafe flag: --never_fsync=true W0423 04:50:11.795343 2425 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 W0423 04:50:11.795387 2425 flags.cc:404] Enabled experimental flag: --principal=kudu/127.1.146.65 W0423 04:50:11.795439 2425 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.146.65 I0423 04:50:11.797866 2425 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.1.146.65:0 --rpc_server_allow_ephemeral_ports=true --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab --principal=kudu/127.1.146.65 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/data/info.pb --webserver_interface=127.1.146.65 --webserver_port=0 --tserver_master_addrs=127.1.146.126:37371 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.1.146.65 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-SNAPSHOT revision 0fbe932a3603b2016b82cf2b53ebd4aeb374ae6b build type DEBUG built by None at 23 Apr 2019 04:42:01 UTC on jenkins-slave-8qw8 build id 17242 I0423 04:50:11.804781 2425 system_ntp.cc:202] NTP initialized. Skew: 500ppm Current error: 79516us Apr 23 04:50:11 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM I0423 04:50:11.806424 2425 init.cc:359] Logged in from keytab as kudu/127.1.146.65@KRBTEST.COM (short username kudu) I0423 04:50:11.807356 2425 fs_manager.cc:263] Metadata directory not provided I0423 04:50:11.807780 2425 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0423 04:50:11.808041 2425 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0423 04:50:11.808104 2425 server_base.cc:434] Attempting to create new FS layout instead I0423 04:50:11.810052 2425 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/data/instance: uuid: "e0927b718aa7436d869a7e08e86c2ade" format_stamp: "Formatted at 2019-04-23 04:50:11 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:11.810433 2425 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/wal/instance: uuid: "e0927b718aa7436d869a7e08e86c2ade" format_stamp: "Formatted at 2019-04-23 04:50:11 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:11.815897 2425 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s I0423 04:50:11.816707 2425 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0423 04:50:11.817126 2425 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0423 04:50:11.820701 2425 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0423 04:50:11.820863 2425 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/data,/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/wal uuid: "e0927b718aa7436d869a7e08e86c2ade" format_stamp: "Formatted at 2019-04-23 04:50:11 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:11.821018 2425 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0423 04:50:11.860399 2425 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0423 04:50:11.861820 2425 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0423 04:50:11.861907 2425 ts_tablet_manager.cc:376] Registered 0 tablets I0423 04:50:11.868438 2425 rpc_server.cc:205] RPC server started. Bound to: 127.1.146.65:36155 I0423 04:50:11.870739 2425 webserver.cc:308] Webserver started at http://127.1.146.65:35511/ using document root and password file I0423 04:50:11.871315 2425 server_base.cc:608] Dumped server information to /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzCombinations_TestAuthzTable.TestAuthorizeTable_5.1555994943536608-1609/minicluster-data/ts-0/data/info.pb I0423 04:50:11.876834 1609 external_mini_cluster.cc:995] Started /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver as pid 2425 Apr 23 04:50:11 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555994989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM Apr 23 04:50:11 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.65@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM I0423 04:50:11.915900 2550 heartbeater.cc:345] Connected to a master server at 127.1.146.126:37371 I0423 04:50:11.916059 2550 heartbeater.cc:426] Registering TS with master... I0423 04:50:11.916435 2550 heartbeater.cc:475] Master 127.1.146.126:37371 requested a full tablet report, sending... I0423 04:50:11.917670 2379 ts_manager.cc:159] Registered new tserver with Master: e0927b718aa7436d869a7e08e86c2ade (127.1.146.65:36155) I0423 04:50:11.919131 2379 master_service.cc:271] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.146.65@KRBTEST.COM'} at 127.1.146.65:34583 I0423 04:50:11.919445 1609 external_mini_cluster.cc:623] 1 TS(s) registered with all masters WARNING: no policy specified for impala@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "impala@KRBTEST.COM" created. WARNING: no policy specified for kudu@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu@KRBTEST.COM" created. Apr 23 04:50:12 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995012, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for kudu@KRBTEST.COM: Apr 23 04:50:12 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995012, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM Apr 23 04:50:12 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995012, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM I0423 04:50:12.921232 2550 heartbeater.cc:467] Master 127.1.146.126:37371 was elected leader, sending a full tablet report... W0423 04:50:13.100873 1609 sentry_client.cc:152] Time spent create Sentry role: real 1.065s user 0.000s sys 0.000s Apr 23 04:50:13 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995000, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM 04:50:13.857 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:250) Create database event has incomplete information. dbName: db location: null I0423 04:50:13.907375 2379 catalog_manager.cc:1414] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51254: name: "db.table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 0 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 0 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } Apr 23 04:50:13 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM 04:50:14.431 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:250) Create database event has incomplete information. dbName: db location: null 04:50:14.450 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = table, location = null I0423 04:50:14.533381 2471 tablet_service.cc:1017] Processing CreateTablet for tablet e16baf1cd7bc41bfae7c5b5745cfabfa (table=db.table [id=e069a4630f9f40c0b19dc02f63bab5c9]), partition=RANGE (key) PARTITION UNBOUNDED I0423 04:50:14.533884 2471 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e16baf1cd7bc41bfae7c5b5745cfabfa. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:50:14.540899 2597 tablet_bootstrap.cc:439] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade: Bootstrap starting. I0423 04:50:14.542789 2597 tablet_bootstrap.cc:590] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade: No blocks or log segments found. Creating new log. I0423 04:50:14.545383 2597 log.cc:525] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade: Log is configured to *not* fsync() on all Append() calls I0423 04:50:14.549813 2597 tablet_bootstrap.cc:439] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade: No bootstrap required, opened a new log I0423 04:50:14.550112 2597 ts_tablet_manager.cc:1053] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s I0423 04:50:14.554927 2597 raft_consensus.cc:340] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } } I0423 04:50:14.556644 2597 raft_consensus.cc:366] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:50:14.556771 2597 raft_consensus.cc:705] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0927b718aa7436d869a7e08e86c2ade, State: Initialized, Role: FOLLOWER I0423 04:50:14.557343 2597 consensus_queue.cc:229] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } } I0423 04:50:14.557485 2597 raft_consensus.cc:380] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:50:14.557554 2597 raft_consensus.cc:472] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:50:14.557651 2597 raft_consensus.cc:2886] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Advancing to term 1 I0423 04:50:14.558730 2597 raft_consensus.cc:494] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } } I0423 04:50:14.560976 2597 leader_election.cc:310] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0927b718aa7436d869a7e08e86c2ade; no voters: I0423 04:50:14.561403 2597 leader_election.cc:296] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:50:14.561587 2599 raft_consensus.cc:2640] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:50:14.562146 2599 raft_consensus.cc:667] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [term 1 LEADER]: Becoming Leader. State: Replica: e0927b718aa7436d869a7e08e86c2ade, State: Running, Role: LEADER I0423 04:50:14.564901 2599 consensus_queue.cc:206] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } } I0423 04:50:14.565968 2597 ts_tablet_manager.cc:1081] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s I0423 04:50:14.569209 2380 catalog_manager.cc:3975] T e16baf1cd7bc41bfae7c5b5745cfabfa P e0927b718aa7436d869a7e08e86c2ade reported cstate change: term changed from 0 to 1, leader changed from to e0927b718aa7436d869a7e08e86c2ade (127.1.146.65). New cstate: current_term: 1 leader_uuid: "e0927b718aa7436d869a7e08e86c2ade" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } health_report { overall_health: HEALTHY } } } I0423 04:50:14.609639 2379 catalog_manager.cc:1414] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51254: name: "db.second_table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 0 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 0 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } 04:50:14.822 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = table, location = null 04:50:14.826 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null I0423 04:50:14.845490 2471 tablet_service.cc:1017] Processing CreateTablet for tablet 32ace7e79bda41c58a6f21de29fe050c (table=db.second_table [id=c66760acdc694b49aee6f536a89b0bd3]), partition=RANGE (key) PARTITION UNBOUNDED I0423 04:50:14.845721 2471 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 32ace7e79bda41c58a6f21de29fe050c. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:50:14.848163 2597 tablet_bootstrap.cc:439] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade: Bootstrap starting. I0423 04:50:14.848924 2597 tablet_bootstrap.cc:590] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade: No blocks or log segments found. Creating new log. I0423 04:50:14.853246 2597 tablet_bootstrap.cc:439] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade: No bootstrap required, opened a new log I0423 04:50:14.853415 2597 ts_tablet_manager.cc:1053] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s I0423 04:50:14.854003 2597 raft_consensus.cc:340] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } } I0423 04:50:14.854027 2597 raft_consensus.cc:366] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:50:14.854058 2597 raft_consensus.cc:705] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0927b718aa7436d869a7e08e86c2ade, State: Initialized, Role: FOLLOWER I0423 04:50:14.854200 2597 consensus_queue.cc:229] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } } I0423 04:50:14.854233 2597 raft_consensus.cc:380] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:50:14.854246 2597 raft_consensus.cc:472] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:50:14.854269 2597 raft_consensus.cc:2886] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 0 FOLLOWER]: Advancing to term 1 I0423 04:50:14.855154 2597 raft_consensus.cc:494] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } } I0423 04:50:14.855252 2597 leader_election.cc:310] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0927b718aa7436d869a7e08e86c2ade; no voters: I0423 04:50:14.855347 2597 leader_election.cc:296] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:50:14.855414 2599 raft_consensus.cc:2640] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:50:14.855474 2599 raft_consensus.cc:667] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [term 1 LEADER]: Becoming Leader. State: Replica: e0927b718aa7436d869a7e08e86c2ade, State: Running, Role: LEADER I0423 04:50:14.855608 2599 consensus_queue.cc:206] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } } I0423 04:50:14.856189 2597 ts_tablet_manager.cc:1081] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0423 04:50:14.857123 2380 catalog_manager.cc:3975] T 32ace7e79bda41c58a6f21de29fe050c P e0927b718aa7436d869a7e08e86c2ade reported cstate change: term changed from 0 to 1, leader changed from to e0927b718aa7436d869a7e08e86c2ade (127.1.146.65). New cstate: current_term: 1 leader_uuid: "e0927b718aa7436d869a7e08e86c2ade" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0927b718aa7436d869a7e08e86c2ade" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 36155 } health_report { overall_health: HEALTHY } } } Apr 23 04:50:15 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995015, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for test-user@KRBTEST.COM: Apr 23 04:50:15 dist-test-slave-dist-test-slave-rk63 krb5kdc[2135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995015, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM W0423 04:50:15.119634 2379 sentry_authz_provider.cc:269] Action on table with authorizable scope
is not permitted for user [Krb5LoginModule]: Entering logout [Krb5LoginModule]: logged out Subject 04:50:15.171 [SENTRY - ERROR - service-shutdown] (SentryService.java:603) Error stopping SentryService java.lang.NullPointerException at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:187) at org.apache.sentry.service.thrift.SentryService.stopSentryStoreCleaner(SentryService.java:425) at org.apache.sentry.service.thrift.SentryService.stop(SentryService.java:504) at org.apache.sentry.service.thrift.SentryService$CommandImpl$1.run(SentryService.java:601) at java.lang.Thread.run(Thread.java:748) I0423 04:50:20.177132 2428 client.cc:56] TSocket::open() error on socket (after THRIFT_POLL) Connection refused W0423 04:50:20.177248 2428 client.h:346] Failed to connect to Sentry (127.1.146.84:10000): Network error: failed to open Sentry connection: socket open() error: Connection refused I0423 04:50:20.178043 1609 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver with pid 2425 I0423 04:50:20.181993 1609 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master with pid 2353 Shutting down hive metastore. [ OK ] AuthzCombinations/TestAuthzTable.TestAuthorizeTable/5 (31171 ms) [----------] 1 test from AuthzCombinations/TestAuthzTable (31171 ms total) [----------] 1 test from AuthzFuncCombinations/AuthzErrorHandlingTest [ RUN ] AuthzFuncCombinations/AuthzErrorHandlingTest.TestNonExistentTable/4 Loading random data Initializing database '/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/principal' for realm 'KRBTEST.COM', master key name 'K/M@KRBTEST.COM' Apr 23 04:50:20 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): setting up network... Apr 23 04:50:20 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): listening on fd 9: udp 0.0.0.0.0 (pktinfo) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked krb5kdc: Invalid argument - Cannot request packet info for udp socket address :: port 0 Apr 23 04:50:20 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): skipping unrecognized local address family 17 Apr 23 04:50:20 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): skipping unrecognized local address family 17 Apr 23 04:50:20 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): set up 1 sockets Apr 23 04:50:20 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): commencing operation krb5kdc: starting... W0423 04:50:21.063570 1609 mini_kdc.cc:119] Time spent starting KDC: real 0.369s user 0.002s sys 0.003s WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "test-admin@KRBTEST.COM" created. WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "test-user@KRBTEST.COM" created. WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy Authenticating as principal slave/admin@KRBTEST.COM with password. Principal "joe-interloper@KRBTEST.COM" created. Authenticating as principal slave/admin@KRBTEST.COM with password. Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/test-user.keytab. Entry for principal test-user with kvno 1, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/test-user.keytab. Apr 23 04:50:21 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for test-admin@KRBTEST.COM: WARNING: no policy specified for hive/127.0.0.1@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "hive/127.0.0.1@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal hive/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. Entry for principal hive/127.0.0.1 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/hive_127.0.0.1.keytab. 2019-04-23 04:50:21: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/derby.log -Djava.security.krb5.conf=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5.conf SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/apache-sentry-505b42e81a9d85c4ebe8db3f48ad7a6e824a5db5-bin/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] log4j:ERROR A "org.apache.solr.util.SolrLogLayout" object is not assignable to a "org.apache.log4j.Layout" variable. log4j:ERROR The class "org.apache.log4j.Layout" was loaded by log4j:ERROR [sun.misc.Launcher$AppClassLoader@271053e1] whereas object of type log4j:ERROR "org.apache.solr.util.SolrLogLayout" was loaded by [sun.misc.Launcher$AppClassLoader@271053e1]. Starting hive metastore on port 0 log4j:ERROR No layout set for the appender named [CONSOLE]. Apr 23 04:50:32 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995032, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Apr 23 04:50:32 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995032, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM WARNING: no policy specified for sentry/127.1.146.84@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "sentry/127.1.146.84@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Entry for principal sentry/127.1.146.84 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab. Picked up JAVA_TOOL_OPTIONS: -Djava.security.krb5.conf=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5.conf -Dhive.metastore.uris=thrift://127.0.0.1:33339 -Dhive.metastore.sasl.enabled=true -Dhive.metastore.kerberos.principal=hive/127.0.0.1@KRBTEST.COM SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/apache-sentry-505b42e81a9d85c4ebe8db3f48ad7a6e824a5db5-bin/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 04:50:37.778 [SENTRY - WARN - main] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored 04:50:39.389 [SENTRY - WARN - main] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt true ticketCache is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5cc isInitiator false KeyTab is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab refreshKrb5Config is true principal is sentry/127.1.146.84@KRBTEST.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration Acquire TGT from Cache Principal is sentry/127.1.146.84@KRBTEST.COM null credentials from Ticket Cache principal is sentry/127.1.146.84@KRBTEST.COM Will use keytab Commit Succeeded Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt true ticketCache is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5cc isInitiator true KeyTab is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab refreshKrb5Config is true principal is sentry/127.1.146.84@KRBTEST.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration Acquire TGT from Cache Principal is sentry/127.1.146.84@KRBTEST.COM null credentials from Ticket Cache Apr 23 04:50:40 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995040, etypes {rep=17 tkt=17 ses=17}, sentry/127.1.146.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM principal is sentry/127.1.146.84@KRBTEST.COM Will use keytab Commit Succeeded Apr 23 04:50:41 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995040, etypes {rep=17 tkt=17 ses=17}, sentry/127.1.146.84@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM Sentry HMS support is ready 04:50:42.453 [SENTRY - WARN - sentry-service] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored Sentry service is ready to serve client requests I0423 04:50:43.104270 1609 mini_sentry.cc:85] Time spent Starting Sentry: real 10.331s user 0.013s sys 0.025s WARNING: no policy specified for kudu/127.1.146.126@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu/127.1.146.126@KRBTEST.COM" created. Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. Entry for principal kudu/127.1.146.126 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab. I0423 04:50:43.131052 1609 external_mini_cluster.cc:933] Running /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.1.146.126:39025 --webserver_interface=127.1.146.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab --principal=kudu/127.1.146.126 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user --sentry_service_send_timeout_seconds=5 --sentry_service_recv_timeout_seconds=5 --trusted_user_acl=impala --user_acl=test-user,impala --sentry_privileges_cache_capacity_mb=0 --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:33339 --hive_metastore_sasl_enabled=true --sentry_service_rpc_addresses=127.1.146.84:10000 with env {KRB5CCNAME=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes} WARNING: Logging before InitGoogleLogging() is written to STDERR W0423 04:50:43.180063 2851 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0423 04:50:43.180207 2851 flags.cc:404] Enabled unsafe flag: --principal=kudu/127.1.146.126 W0423 04:50:43.180233 2851 flags.cc:404] Enabled unsafe flag: --never_fsync=true W0423 04:50:43.181275 2851 flags.cc:404] Enabled experimental flag: --hive_metastore_sasl_enabled=true W0423 04:50:43.181298 2851 flags.cc:404] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:33339 W0423 04:50:43.181303 2851 flags.cc:404] Enabled experimental flag: --trusted_user_acl=impala W0423 04:50:43.181309 2851 flags.cc:404] Enabled experimental flag: --ipki_ca_key_size=1024 W0423 04:50:43.181318 2851 flags.cc:404] Enabled experimental flag: --sentry_service_recv_timeout_seconds=5 W0423 04:50:43.181324 2851 flags.cc:404] Enabled experimental flag: --sentry_service_rpc_addresses=127.1.146.84:10000 W0423 04:50:43.181329 2851 flags.cc:404] Enabled experimental flag: --sentry_service_send_timeout_seconds=5 W0423 04:50:43.181339 2851 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 W0423 04:50:43.181401 2851 flags.cc:404] Enabled experimental flag: --tsk_num_rsa_bits=512 W0423 04:50:43.181412 2851 flags.cc:404] Enabled experimental flag: --rpc_reuseport=true W0423 04:50:43.181432 2851 flags.cc:404] Enabled experimental flag: --principal=kudu/127.1.146.126 I0423 04:50:43.183946 2851 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/wal --hive_metastore_sasl_enabled=true --hive_metastore_uris=thrift://127.0.0.1:33339 --trusted_user_acl=impala --ipki_ca_key_size=1024 --sentry_privileges_cache_capacity_mb=0 --sentry_service_recv_timeout_seconds=5 --sentry_service_rpc_addresses=127.1.146.84:10000 --sentry_service_send_timeout_seconds=5 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.1.146.126:39025 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.126.keytab --principal=kudu/127.1.146.126 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user,impala --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/data/info.pb --webserver_interface=127.1.146.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-SNAPSHOT revision 0fbe932a3603b2016b82cf2b53ebd4aeb374ae6b build type DEBUG built by None at 23 Apr 2019 04:42:01 UTC on jenkins-slave-8qw8 build id 17242 I0423 04:50:43.189271 2851 system_ntp.cc:202] NTP initialized. Skew: 500ppm Current error: 95516us Apr 23 04:50:43 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995043, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM I0423 04:50:43.190655 2851 init.cc:359] Logged in from keytab as kudu/127.1.146.126@KRBTEST.COM (short username kudu) I0423 04:50:43.191468 2851 fs_manager.cc:263] Metadata directory not provided I0423 04:50:43.191498 2851 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0423 04:50:43.191697 2851 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0423 04:50:43.191717 2851 server_base.cc:434] Attempting to create new FS layout instead I0423 04:50:43.193397 2851 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/data/instance: uuid: "fc4cb833d953421f86b2acb623faa239" format_stamp: "Formatted at 2019-04-23 04:50:43 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:43.193655 2851 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/wal/instance: uuid: "fc4cb833d953421f86b2acb623faa239" format_stamp: "Formatted at 2019-04-23 04:50:43 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:43.197878 2851 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s I0423 04:50:43.198417 2851 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0423 04:50:43.198689 2851 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0423 04:50:43.201268 2851 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0423 04:50:43.201342 2851 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/data,/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/wal uuid: "fc4cb833d953421f86b2acb623faa239" format_stamp: "Formatted at 2019-04-23 04:50:43 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:43.201429 2851 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0423 04:50:43.252041 2851 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0423 04:50:43.256971 2851 rpc_server.cc:205] RPC server started. Bound to: 127.1.146.126:39025 I0423 04:50:43.257582 2851 webserver.cc:308] Webserver started at http://127.1.146.126:38105/ using document root and password file I0423 04:50:43.258071 2851 server_base.cc:608] Dumped server information to /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/master-0/data/info.pb I0423 04:50:43.260406 2911 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:50:43.265144 2911 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239: Bootstrap starting. I0423 04:50:43.265254 1609 external_mini_cluster.cc:995] Started /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master as pid 2851 I0423 04:50:43.267277 2911 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239: No blocks or log segments found. Creating new log. I0423 04:50:43.267895 2911 log.cc:525] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239: Log is configured to *not* fsync() on all Append() calls I0423 04:50:43.268889 2911 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239: No bootstrap required, opened a new log WARNING: no policy specified for kudu/127.1.146.65@KRBTEST.COM; defaulting to no policy I0423 04:50:43.271328 2911 raft_consensus.cc:340] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4cb833d953421f86b2acb623faa239" member_type: VOTER } I0423 04:50:43.271384 2911 raft_consensus.cc:366] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:50:43.271423 2911 raft_consensus.cc:705] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc4cb833d953421f86b2acb623faa239, State: Initialized, Role: FOLLOWER I0423 04:50:43.271770 2911 consensus_queue.cc:229] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4cb833d953421f86b2acb623faa239" member_type: VOTER } I0423 04:50:43.271817 2911 raft_consensus.cc:380] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:50:43.271853 2911 raft_consensus.cc:472] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:50:43.271911 2911 raft_consensus.cc:2886] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 0 FOLLOWER]: Advancing to term 1 Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu/127.1.146.65@KRBTEST.COM" created. I0423 04:50:43.273643 2911 raft_consensus.cc:494] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4cb833d953421f86b2acb623faa239" member_type: VOTER } I0423 04:50:43.273952 2911 leader_election.cc:310] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc4cb833d953421f86b2acb623faa239; no voters: I0423 04:50:43.274227 2911 leader_election.cc:296] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:50:43.274320 2914 raft_consensus.cc:2640] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:50:43.274451 2914 raft_consensus.cc:667] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [term 1 LEADER]: Becoming Leader. State: Replica: fc4cb833d953421f86b2acb623faa239, State: Running, Role: LEADER I0423 04:50:43.274657 2914 consensus_queue.cc:206] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4cb833d953421f86b2acb623faa239" member_type: VOTER } I0423 04:50:43.275596 2914 sys_catalog.cc:337] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc4cb833d953421f86b2acb623faa239" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4cb833d953421f86b2acb623faa239" member_type: VOTER } } I0423 04:50:43.275895 2915 sys_catalog.cc:337] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc4cb833d953421f86b2acb623faa239. Latest consensus state: current_term: 1 leader_uuid: "fc4cb833d953421f86b2acb623faa239" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4cb833d953421f86b2acb623faa239" member_type: VOTER } } I0423 04:50:43.275962 2911 sys_catalog.cc:337] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "fc4cb833d953421f86b2acb623faa239" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4cb833d953421f86b2acb623faa239" member_type: VOTER } } I0423 04:50:43.276033 2915 sys_catalog.cc:340] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [sys.catalog]: This master's current role is: LEADER I0423 04:50:43.276044 2914 sys_catalog.cc:340] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [sys.catalog]: This master's current role is: LEADER I0423 04:50:43.276108 2911 sys_catalog.cc:340] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [sys.catalog]: This master's current role is: LEADER I0423 04:50:43.277629 2911 sys_catalog.cc:424] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239 [sys.catalog]: configured and running, proceeding with master startup. I0423 04:50:43.278450 2922 hms_notification_log_listener.cc:228] Skipping Hive Metastore notification log poll: Service unavailable: Leader not yet ready to serve requests W0423 04:50:43.284832 2924 catalog_manager.cc:1112] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0423 04:50:43.284865 2924 catalog_manager.cc:595] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0423 04:50:43.284922 2919 catalog_manager.cc:1054] Loading table and tablet metadata into memory... I0423 04:50:43.286119 2919 catalog_manager.cc:1065] Initializing Kudu internal certificate authority... Authenticating as principal test-admin/admin@KRBTEST.COM with password. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type des3-cbc-sha1 added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. Entry for principal kudu/127.1.146.65 with kvno 2, encryption type arcfour-hmac added to keytab WRFILE:/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab. I0423 04:50:43.291680 1609 external_mini_cluster.cc:933] Running /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.1.146.65:0 --local_ip_for_outbound_sockets=127.1.146.65 --webserver_interface=127.1.146.65 --webserver_port=0 --tserver_master_addrs=127.1.146.126:39025 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab --principal=kudu/127.1.146.65 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user with env {KRB5CCNAME=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes} I0423 04:50:43.306037 2919 catalog_manager.cc:949] Generated new certificate authority record I0423 04:50:43.306972 2919 catalog_manager.cc:1074] Loading token signing keys... I0423 04:50:43.314582 2919 catalog_manager.cc:4279] T 00000000000000000000000000000000 P fc4cb833d953421f86b2acb623faa239: Generated new TSK 0 I0423 04:50:43.315004 2919 catalog_manager.cc:1085] Loading latest processed Hive Metastore notification log event ID... WARNING: Logging before InitGoogleLogging() is written to STDERR W0423 04:50:43.348834 2926 flags.cc:404] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0423 04:50:43.349010 2926 flags.cc:404] Enabled unsafe flag: --principal=kudu/127.1.146.65 W0423 04:50:43.349052 2926 flags.cc:404] Enabled unsafe flag: --never_fsync=true W0423 04:50:43.350278 2926 flags.cc:404] Enabled experimental flag: --ipki_server_key_size=1024 W0423 04:50:43.350317 2926 flags.cc:404] Enabled experimental flag: --principal=kudu/127.1.146.65 W0423 04:50:43.350374 2926 flags.cc:404] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.146.65 I0423 04:50:43.352885 2926 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.1.146.65:0 --rpc_server_allow_ephemeral_ports=true --keytab_file=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/kudu_127.1.146.65.keytab --principal=kudu/127.1.146.65 --rpc_authentication=required --superuser_acl=test-admin --user_acl=test-user --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/data/info.pb --webserver_interface=127.1.146.65 --webserver_port=0 --tserver_master_addrs=127.1.146.126:39025 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.1.146.65 --log_dir=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-SNAPSHOT revision 0fbe932a3603b2016b82cf2b53ebd4aeb374ae6b build type DEBUG built by None at 23 Apr 2019 04:42:01 UTC on jenkins-slave-8qw8 build id 17242 I0423 04:50:43.359558 2926 system_ntp.cc:202] NTP initialized. Skew: 500ppm Current error: 95516us Apr 23 04:50:43 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995043, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM I0423 04:50:43.360983 2926 init.cc:359] Logged in from keytab as kudu/127.1.146.65@KRBTEST.COM (short username kudu) I0423 04:50:43.361660 2926 fs_manager.cc:263] Metadata directory not provided I0423 04:50:43.361698 2926 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0423 04:50:43.361858 2926 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0423 04:50:43.361874 2926 server_base.cc:434] Attempting to create new FS layout instead I0423 04:50:43.363513 2926 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/data/instance: uuid: "a3426d33e6924d3cb200c3e125b29dd1" format_stamp: "Formatted at 2019-04-23 04:50:43 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:43.363759 2926 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/wal/instance: uuid: "a3426d33e6924d3cb200c3e125b29dd1" format_stamp: "Formatted at 2019-04-23 04:50:43 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:43.368000 2926 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s I0423 04:50:43.368505 2926 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0423 04:50:43.368803 2926 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0423 04:50:43.371213 2926 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0423 04:50:43.371294 2926 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/data,/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/wal uuid: "a3426d33e6924d3cb200c3e125b29dd1" format_stamp: "Formatted at 2019-04-23 04:50:43 on dist-test-slave-dist-test-slave-rk63" I0423 04:50:43.371373 2926 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0423 04:50:43.395115 2926 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0423 04:50:43.395917 2926 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0423 04:50:43.395944 2926 ts_tablet_manager.cc:376] Registered 0 tablets I0423 04:50:43.402084 2926 rpc_server.cc:205] RPC server started. Bound to: 127.1.146.65:34713 I0423 04:50:43.402693 2926 webserver.cc:308] Webserver started at http://127.1.146.65:34843/ using document root and password file I0423 04:50:43.403120 2926 server_base.cc:608] Dumped server information to /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/minicluster-data/ts-0/data/info.pb I0423 04:50:43.409440 1609 external_mini_cluster.cc:995] Started /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver as pid 2926 Apr 23 04:50:43 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995043, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.65@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM Apr 23 04:50:43 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM I0423 04:50:43.417626 3047 heartbeater.cc:345] Connected to a master server at 127.1.146.126:39025 I0423 04:50:43.417752 3047 heartbeater.cc:426] Registering TS with master... I0423 04:50:43.418028 3047 heartbeater.cc:475] Master 127.1.146.126:39025 requested a full tablet report, sending... I0423 04:50:43.419195 2878 ts_manager.cc:159] Registered new tserver with Master: a3426d33e6924d3cb200c3e125b29dd1 (127.1.146.65:34713) I0423 04:50:43.420286 2878 master_service.cc:271] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.146.65@KRBTEST.COM'} at 127.1.146.65:36441 I0423 04:50:43.421058 1609 external_mini_cluster.cc:623] 1 TS(s) registered with all masters WARNING: no policy specified for impala@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "impala@KRBTEST.COM" created. WARNING: no policy specified for kudu@KRBTEST.COM; defaulting to no policy Authenticating as principal test-admin/admin@KRBTEST.COM with password. Principal "kudu@KRBTEST.COM" created. Apr 23 04:50:43 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995043, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for kudu@KRBTEST.COM: Apr 23 04:50:43 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995043, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM Apr 23 04:50:43 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995043, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM I0423 04:50:44.422104 3047 heartbeater.cc:467] Master 127.1.146.126:39025 was elected leader, sending a full tablet report... W0423 04:50:44.548087 1609 sentry_client.cc:152] Time spent create Sentry role: real 1.033s user 0.000s sys 0.000s Apr 23 04:50:45 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995032, etypes {rep=17 tkt=17 ses=17}, hive/127.0.0.1@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM 04:50:45.144 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:250) Create database event has incomplete information. dbName: db location: null Apr 23 04:50:45 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995043, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM I0423 04:50:45.319259 2875 catalog_manager.cc:1414] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33970: name: "db.table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 0 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 0 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } Apr 23 04:50:45 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995043, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.146.126@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM 04:50:45.651 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:250) Create database event has incomplete information. dbName: db location: null 04:50:46.086 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:250) Create database event has incomplete information. dbName: db location: null 04:50:46.100 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = table, location = null I0423 04:50:46.159634 2984 tablet_service.cc:1017] Processing CreateTablet for tablet eec9b928aa1a47119e054e07710c9eb0 (table=db.table [id=be6248094b6b40acaf96fc6aa01325cd]), partition=RANGE (key) PARTITION UNBOUNDED I0423 04:50:46.160137 2984 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet eec9b928aa1a47119e054e07710c9eb0. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:50:46.168890 3095 tablet_bootstrap.cc:439] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1: Bootstrap starting. I0423 04:50:46.170979 3095 tablet_bootstrap.cc:590] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1: No blocks or log segments found. Creating new log. I0423 04:50:46.171759 3095 log.cc:525] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1: Log is configured to *not* fsync() on all Append() calls I0423 04:50:46.173573 3095 tablet_bootstrap.cc:439] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1: No bootstrap required, opened a new log I0423 04:50:46.173830 3095 ts_tablet_manager.cc:1053] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s I0423 04:50:46.177158 3095 raft_consensus.cc:340] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } } I0423 04:50:46.177302 3095 raft_consensus.cc:366] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:50:46.177414 3095 raft_consensus.cc:705] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3426d33e6924d3cb200c3e125b29dd1, State: Initialized, Role: FOLLOWER I0423 04:50:46.177909 3095 consensus_queue.cc:229] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } } I0423 04:50:46.178030 3095 raft_consensus.cc:380] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:50:46.178094 3095 raft_consensus.cc:472] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:50:46.178174 3095 raft_consensus.cc:2886] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Advancing to term 1 I0423 04:50:46.179131 3095 raft_consensus.cc:494] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } } I0423 04:50:46.179567 3095 leader_election.cc:310] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3426d33e6924d3cb200c3e125b29dd1; no voters: I0423 04:50:46.179951 3095 leader_election.cc:296] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:50:46.180728 3097 raft_consensus.cc:2640] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:50:46.180938 3097 raft_consensus.cc:667] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [term 1 LEADER]: Becoming Leader. State: Replica: a3426d33e6924d3cb200c3e125b29dd1, State: Running, Role: LEADER I0423 04:50:46.181300 3097 consensus_queue.cc:206] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } } I0423 04:50:46.183802 2878 catalog_manager.cc:3975] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1 reported cstate change: term changed from 0 to 1, leader changed from to a3426d33e6924d3cb200c3e125b29dd1 (127.1.146.65). New cstate: current_term: 1 leader_uuid: "a3426d33e6924d3cb200c3e125b29dd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } health_report { overall_health: HEALTHY } } } I0423 04:50:46.185505 3095 ts_tablet_manager.cc:1081] T eec9b928aa1a47119e054e07710c9eb0 P a3426d33e6924d3cb200c3e125b29dd1: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s I0423 04:50:46.237589 2875 catalog_manager.cc:1414] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33970: name: "db.second_table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 0 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 0 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } 04:50:46.585 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = table, location = null 04:50:46.589 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null I0423 04:50:46.606462 2984 tablet_service.cc:1017] Processing CreateTablet for tablet c43d9348f8b64aee9674387d7f2502dd (table=db.second_table [id=84280915185148b9afb3588280aa75ec]), partition=RANGE (key) PARTITION UNBOUNDED I0423 04:50:46.606683 2984 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c43d9348f8b64aee9674387d7f2502dd. 1 dirs total, 0 dirs full, 0 dirs failed I0423 04:50:46.608316 3095 tablet_bootstrap.cc:439] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1: Bootstrap starting. I0423 04:50:46.609131 3095 tablet_bootstrap.cc:590] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1: No blocks or log segments found. Creating new log. I0423 04:50:46.610066 3095 tablet_bootstrap.cc:439] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1: No bootstrap required, opened a new log I0423 04:50:46.610144 3095 ts_tablet_manager.cc:1053] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0423 04:50:46.610652 3095 raft_consensus.cc:340] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } } I0423 04:50:46.610680 3095 raft_consensus.cc:366] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0423 04:50:46.610694 3095 raft_consensus.cc:705] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3426d33e6924d3cb200c3e125b29dd1, State: Initialized, Role: FOLLOWER I0423 04:50:46.610812 3095 consensus_queue.cc:229] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } } I0423 04:50:46.610841 3095 raft_consensus.cc:380] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0423 04:50:46.610853 3095 raft_consensus.cc:472] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0423 04:50:46.610878 3095 raft_consensus.cc:2886] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 0 FOLLOWER]: Advancing to term 1 I0423 04:50:46.611469 3095 raft_consensus.cc:494] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } } I0423 04:50:46.611694 3095 leader_election.cc:310] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3426d33e6924d3cb200c3e125b29dd1; no voters: I0423 04:50:46.611775 3095 leader_election.cc:296] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [CANDIDATE]: Term 1 election: Requested vote from peers I0423 04:50:46.611831 3097 raft_consensus.cc:2640] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 1 FOLLOWER]: Leader election won for term 1 I0423 04:50:46.611955 3097 raft_consensus.cc:667] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [term 1 LEADER]: Becoming Leader. State: Replica: a3426d33e6924d3cb200c3e125b29dd1, State: Running, Role: LEADER I0423 04:50:46.612057 3097 consensus_queue.cc:206] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } } I0423 04:50:46.612195 3095 ts_tablet_manager.cc:1081] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0423 04:50:46.613277 2878 catalog_manager.cc:3975] T c43d9348f8b64aee9674387d7f2502dd P a3426d33e6924d3cb200c3e125b29dd1 reported cstate change: term changed from 0 to 1, leader changed from to a3426d33e6924d3cb200c3e125b29dd1 (127.1.146.65). New cstate: current_term: 1 leader_uuid: "a3426d33e6924d3cb200c3e125b29dd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3426d33e6924d3cb200c3e125b29dd1" member_type: VOTER last_known_addr { host: "127.1.146.65" port: 34713 } health_report { overall_health: HEALTHY } } } Apr 23 04:50:46 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995046, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for test-user@KRBTEST.COM: Apr 23 04:50:46 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995046, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.146.126@KRBTEST.COM W0423 04:50:46.906098 2875 sentry_authz_provider.cc:269] Action on table with authorizable scope
is not permitted for user [Krb5LoginModule]: Entering logout [Krb5LoginModule]: logged out Subject 04:50:46.932 [SENTRY - ERROR - service-shutdown] (SentryService.java:603) Error stopping SentryService java.lang.NullPointerException at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:187) at org.apache.sentry.service.thrift.SentryService.stopSentryStoreCleaner(SentryService.java:425) at org.apache.sentry.service.thrift.SentryService.stop(SentryService.java:504) at org.apache.sentry.service.thrift.SentryService$CommandImpl$1.run(SentryService.java:601) at java.lang.Thread.run(Thread.java:748) I0423 04:50:51.933629 2923 client.cc:56] TSocket::open() error on socket (after THRIFT_POLL) Connection refused W0423 04:50:51.933729 2923 client.h:346] Failed to connect to Sentry (127.1.146.84:10000): Network error: failed to open Sentry connection: socket open() error: Connection refused Picked up JAVA_TOOL_OPTIONS: -Djava.security.krb5.conf=/tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5.conf -Dhive.metastore.uris=thrift://127.0.0.1:33339 -Dhive.metastore.sasl.enabled=true -Dhive.metastore.kerberos.principal=hive/127.0.0.1@KRBTEST.COM SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskFsoggK/thirdparty/src/apache-sentry-505b42e81a9d85c4ebe8db3f48ad7a6e824a5db5-bin/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 04:50:56.727 [SENTRY - WARN - main] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored 04:50:58.215 [SENTRY - WARN - main] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt true ticketCache is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5cc isInitiator false KeyTab is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab refreshKrb5Config is true principal is sentry/127.1.146.84@KRBTEST.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration Acquire TGT from Cache Principal is sentry/127.1.146.84@KRBTEST.COM null credentials from Ticket Cache principal is sentry/127.1.146.84@KRBTEST.COM Will use keytab Commit Succeeded Debug is true storeKey true useTicketCache true useKeyTab true doNotPrompt true ticketCache is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/krb5cc isInitiator true KeyTab is /tmp/dist-test-taskFsoggK/test-tmp/master_sentry-itest.2.AuthzFuncCombinations_AuthzErrorHandlingTest.TestNonExistentTable_4.1555994943536608-1609/krb5kdc/sentry_127.1.146.84.keytab refreshKrb5Config is true principal is sentry/127.1.146.84@KRBTEST.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration Acquire TGT from Cache Principal is sentry/127.1.146.84@KRBTEST.COM null credentials from Ticket Cache Apr 23 04:50:59 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995059, etypes {rep=17 tkt=17 ses=17}, sentry/127.1.146.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM principal is sentry/127.1.146.84@KRBTEST.COM Will use keytab Commit Succeeded Apr 23 04:51:00 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995059, etypes {rep=17 tkt=17 ses=17}, sentry/127.1.146.84@KRBTEST.COM for hive/127.0.0.1@KRBTEST.COM Sentry HMS support is ready 04:51:00.591 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null 04:51:00.826 [SENTRY - WARN - sentry-service] (Log4JLogger.java:96) Metadata has jdbc-type of null yet this is not valid. Ignored 04:51:01.092 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null 04:51:01.112 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null 04:51:01.137 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null Sentry service is ready to serve client requests 04:51:01.616 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null I0423 04:51:01.712808 1609 mini_sentry.cc:85] Time spent Starting Sentry: real 9.779s user 0.007s sys 0.031s Apr 23 04:51:01 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995061, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM Password for kudu@KRBTEST.COM: Apr 23 04:51:01 dist-test-slave-dist-test-slave-rk63 krb5kdc[2632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1555995061, etypes {rep=17 tkt=17 ses=17}, kudu@KRBTEST.COM for sentry/127.1.146.84@KRBTEST.COM 04:51:02.118 [SENTRY - WARN - hms-follower] (NotificationProcessor.java:312) Create table event has incomplete information. dbName = db, tableName = second_table, location = null I0423 04:51:02.534000 1609 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-tserver with pid 2926 I0423 04:51:02.540042 1609 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskFsoggK/build/debug/bin/kudu-master with pid 2851 [Krb5LoginModule]: Entering logout [Krb5LoginModule]: logged out Subject [Krb5LoginModule]: Entering logout [Krb5LoginModule]: logged out Subject 04:51:02.568 [SENTRY - ERROR - service-shutdown] (SentryService.java:603) Error stopping SentryService java.lang.NullPointerException at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:187) at org.apache.sentry.service.thrift.SentryService.stopSentryStoreCleaner(SentryService.java:425) at org.apache.sentry.service.thrift.SentryService.stop(SentryService.java:504) at org.apache.sentry.service.thrift.SentryService$CommandImpl$1.run(SentryService.java:601) at java.lang.Thread.run(Thread.java:748) Shutting down hive metastore. [ OK ] AuthzFuncCombinations/AuthzErrorHandlingTest.TestNonExistentTable/4 (47376 ms) [----------] 1 test from AuthzFuncCombinations/AuthzErrorHandlingTest (47376 ms total) [----------] Global test environment tear-down [==========] 3 tests from 3 test cases ran. (124529 ms total) [ PASSED ] 2 tests. [ FAILED ] 1 test, listed below: [ FAILED ] MasterSentryTest.TestTableOwnership 1 FAILED TEST