2019-05-08T12:47:50,321 INFO [main] conf.MetastoreConf: Unable to find config file hive-site.xml 2019-05-08T12:47:50,324 INFO [main] conf.MetastoreConf: Found configuration file null 2019-05-08T12:47:50,325 INFO [main] conf.MetastoreConf: Unable to find config file hivemetastore-site.xml 2019-05-08T12:47:50,325 INFO [main] conf.MetastoreConf: Found configuration file null 2019-05-08T12:47:50,326 INFO [main] conf.MetastoreConf: Found configuration file file:/opt/apache-hive-metastore-3.0.0-bin/conf/metastore-site.xml 2019-05-08T12:47:50,379 DEBUG [main] lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)]) 2019-05-08T12:47:50,390 DEBUG [main] lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)]) 2019-05-08T12:47:50,390 DEBUG [main] lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[GetGroups]) 2019-05-08T12:47:50,390 DEBUG [main] lib.MutableMetricsFactory: field private org.apache.hadoop.metrics2.lib.MutableGaugeLong org.apache.hadoop.security.UserGroupInformation$UgiMetrics.renewalFailuresTotal with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Renewal failures since startup]) 2019-05-08T12:47:50,390 DEBUG [main] lib.MutableMetricsFactory: field private org.apache.hadoop.metrics2.lib.MutableGaugeInt org.apache.hadoop.security.UserGroupInformation$UgiMetrics.renewalFailures with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Renewal failures since last successful login]) 2019-05-08T12:47:50,391 DEBUG [main] impl.MetricsSystemImpl: UgiMetrics, User and group related metrics 2019-05-08T12:47:50,459 DEBUG [main] security.SecurityUtil: Setting hadoop.security.token.service.use_ip to true 2019-05-08T12:47:50,498 DEBUG [main] util.Shell: setsid exited with exit code 0 2019-05-08T12:47:50,521 DEBUG [main] security.Groups: Creating new Groups object 2019-05-08T12:47:50,524 DEBUG [main] util.NativeCodeLoader: Trying to load the custom-built native-hadoop library... 2019-05-08T12:47:50,524 DEBUG [main] util.NativeCodeLoader: Loaded the native-hadoop library 2019-05-08T12:47:50,526 DEBUG [main] security.JniBasedUnixGroupsMapping: Using JniBasedUnixGroupsMapping for Group resolution 2019-05-08T12:47:50,526 DEBUG [main] security.JniBasedUnixGroupsMappingWithFallback: Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMapping 2019-05-08T12:47:50,586 DEBUG [main] security.Groups: Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000 2019-05-08T12:47:50,591 DEBUG [main] security.UserGroupInformation: hadoop login 2019-05-08T12:47:50,591 DEBUG [main] security.UserGroupInformation: hadoop login commit 2019-05-08T12:47:50,594 DEBUG [main] security.UserGroupInformation: using local user:UnixPrincipal: root 2019-05-08T12:47:50,594 DEBUG [main] security.UserGroupInformation: Using user: "UnixPrincipal: root" with name root 2019-05-08T12:47:50,594 DEBUG [main] security.UserGroupInformation: User entry: "root" 2019-05-08T12:47:50,594 DEBUG [main] security.UserGroupInformation: UGI loginUser:root (auth:SIMPLE) 2019-05-08T12:47:50,613 DEBUG [main] conf.MetastoreConf: MetastoreConf object: Used metastore-site file: file:/opt/apache-hive-metastore-3.0.0-bin/conf/metastore-site.xml Key: old hive key: value: <> Key: old hive key: value: <0.8> Key: old hive key: value: Key: old hive key: value: <0.01> Key: old hive key: value: <0.9> Key: old hive key: value: <10000> Key: old hive key: value: <1000ms> Key: old hive key: value: <0.01> Key: old hive key: value: <5000ms> Key: old hive key: value: <10000> Key: old hive key: value: <600s> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <300> Key: old hive key: value: <1000> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <60s> Key: old hive key: value: <.*> Key: old hive key: value: <> Key: old hive key: value: <1Gb> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <1s> Key: old hive key: value: <> Key: old hive key: value: <0s> Key: old hive key: value: <600s> Key: old hive key: value: <2m> Key: old hive key: value: <2> Key: old hive key: value: <3> Key: old hive key: value: <3> Key: old hive key: value: <2> Key: old hive key: value: Key: old hive key: value: <0> Key: old hive key: value: Key: old hive key: value: <10> Key: old hive key: value: <> Key: old hive key: value: :5432/dpdl_metastore> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <1s> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: <__HIVE_DEFAULT_PARTITION__> Key: old hive key: value: <1d> Key: old hive key: value: <1h> Key: old hive key: value: <7d> Key: old hive key: value: <1d> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <1000> Key: old hive key: value: <1000> Key: old hive key: value: <100> Key: old hive key: value: <0> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: <0s> Key: old hive key: value: <0s> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: <86400s> Key: old hive key: value: <7200s> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <1> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <15> Key: old hive key: value: <10> Key: old hive key: value: Key: old hive key: value: <2000ms> Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: <-1> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <3600s> Key: old hive key: value: <86400s> Key: old hive key: value: <3600s> Key: old hive key: value: <259200s> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <1m> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <100000> Key: old hive key: value: Key: old hive key: value: <10> Key: old hive key: value: <10s> Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: <> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <24h> Key: old hive key: value: <3600s> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <1> Key: old hive key: value: <33554432> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <104857600> Key: old hive key: value: <1000> Key: old hive key: value: <200> Key: old hive key: value: <9083> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <0.0> Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: <5m> Key: old hive key: value: <1> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <10> Key: old hive key: value: <3> Key: old hive key: value: <1> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <100s> Key: old hive key: value: <180s> Key: old hive key: value: <> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <1000> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: <300s> Key: old hive key: value: <> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: <60s> Key: old hive key: value: <4> Key: old hive key: value: <-1> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <> Key: old hive key: value: <> Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: Key: old hive key: value: <42> Key: old hive key: value: <3.141592654> Key: old hive key: value: <1s> Key: old hive key: value: <1s> Key: old hive key: value: <1s> Key: old hive key: value: Key: old hive key: value: <> Finished MetastoreConf object. 2019-05-08T12:47:50,658 INFO [main] metastore.HiveMetaStore: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting HiveMetaStore STARTUP_MSG: host = / STARTUP_MSG: args = [] STARTUP_MSG: version = 3.1.0.3.1.0.0-78 STARTUP_MSG: classpath = /opt/apache-hive-metastore-3.0.0-bin/conf:/opt/apache-hive-metastore-3.0.0-bin/lib/aircompressor-0.8.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/antlr-runtime-3.5.2.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/bonecp-0.8.0.RELEASE.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/commons-dbcp-1.4.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/commons-lang-2.6.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/commons-lang3-3.2.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/commons-pool-1.5.4.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/datanucleus-api-jdo-4.2.4.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/datanucleus-core-4.1.17.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/datanucleus-rdbms-4.1.19.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/derby-10.10.2.0.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/guava-19.0.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/HikariCP-2.6.1.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/hive-storage-api-2.6.1.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/httpcore-4.4.1.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/jackson-annotations-2.9.0.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/jackson-core-2.9.4.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/jackson-databind-2.9.4.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/javax.jdo-3.2.0-m3.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/javolution-5.5.1.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/jline-2.14.3.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/libfb303-0.9.3.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/libthrift-0.9.3.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/log4j-1.2-api-2.8.2.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/log4j-api-2.8.2.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/log4j-core-2.8.2.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/log4j-slf4j-impl-2.8.2.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/metrics-core-3.1.0.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/metrics-json-3.1.0.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/metrics-jvm-3.1.0.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/orc-core-1.4.3.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/postgresql-42.2.5.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/protobuf-java-2.5.0.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/sqlline-1.3.0.jar:/opt/apache-hive-metastore-3.0.0-bin/lib/transaction-api-1.1.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/aliyun-sdk-oss-2.8.3.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.271.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/azure-data-lake-store-sdk-2.2.5.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/azure-keyvault-core-0.8.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/azure-storage-5.4.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-aliyun-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-archive-logs-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-archives-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-aws-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-azure-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-azure-datalake-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-datajoin-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-distcp-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-extras-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-fs2img-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-gridmix-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-kafka-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-openstack-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-resourceestimator-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-rumen-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-sls-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/hadoop-streaming-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/jdom-1.1.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/kafka-clients-0.8.2.1.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/lz4-1.2.0.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/netty-buffer-4.1.17.Final.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/netty-codec-4.1.17.Final.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/netty-codec-http-4.1.17.Final.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/netty-common-4.1.17.Final.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/netty-handler-4.1.17.Final.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/netty-resolver-4.1.17.Final.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/netty-transport-4.1.17.Final.jar:/opt/hadoop-3.1.0/share/hadoop/tools/lib/ojalgo-43.0.jar:/opt/hadoop-3.1.0/etc/hadoop:/opt/hadoop-3.1.0/share/hadoop/common/lib/httpcore-4.4.4.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jetty-util-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jackson-core-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/accessors-smart-1.2.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/stax2-api-3.1.4.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jersey-server-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jetty-servlet-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/httpclient-4.5.2.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jsch-0.1.54.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-io-2.5.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-server-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerby-config-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/avro-1.7.7.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jackson-annotations-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jetty-io-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/junit-4.11.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jetty-xml-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jetty-http-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/hadoop-auth-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jetty-server-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/token-provider-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-common-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/curator-recipes-2.12.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jetty-webapp-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/curator-client-2.12.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/curator-framework-2.12.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jetty-security-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/zookeeper-3.4.9.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-net-3.6.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jersey-json-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/hadoop-annotations-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/snappy-java-1.0.5.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/json-smart-2.3.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/asm-5.0.4.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jersey-core-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jersey-servlet-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-util-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-client-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-codec-1.11.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/re2j-1.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/metrics-core-3.2.4.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jackson-databind-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/kerby-util-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hadoop-3.1.0/share/hadoop/common/lib/commons-lang3-3.4.jar:/opt/hadoop-3.1.0/share/hadoop/common/hadoop-common-3.1.0-tests.jar:/opt/hadoop-3.1.0/share/hadoop/common/hadoop-kms-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/hadoop-common-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/common/hadoop-nfs-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-util-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-io-2.5.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/xz-1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/avro-1.7.7.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-io-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/paranamer-2.3.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-http-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jettison-1.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/hadoop-auth-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-server-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-compress-1.4.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/curator-recipes-2.12.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/curator-client-2.12.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/okio-1.6.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/curator-framework-2.12.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-security-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/zookeeper-3.4.9.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-net-3.6.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/hadoop-annotations-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/gson-2.2.4.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/json-smart-2.3.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/asm-5.0.4.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/netty-all-4.0.52.Final.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/re2j-1.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-lang3-3.4.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.1.0-tests.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-3.1.0-tests.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.1.0-tests.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-client-3.1.0-tests.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-client-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-nfs-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.0-tests.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/jackson-jaxrs-base-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/json-io-2.5.1.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/jersey-client-1.19.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/fst-2.50.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/java-util-1.9.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/guice-4.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/lib/dnsjava-2.1.7.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-common-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-common-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-services-core-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-client-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-registry-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-router-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-tests-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-api-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-services-api-3.1.0.jar:/opt/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.1.0.jar STARTUP_MSG: build = git://ctr-e138-1518143905142-586755-01-000015.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hive -r 56673b027117d8cb3400675b1680a4d992360808; compiled by 'jenkins' on Thu Dec 6 12:27:38 UTC 2018 ************************************************************/ 2019-05-08T12:47:50,680 INFO [main] metastore.HiveMetaStore: Starting hive metastore on port 9083 2019-05-08T12:47:50,691 DEBUG [main] metrics.PerfLogger: 2019-05-08T12:47:50,702 INFO [main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore 2019-05-08T12:47:50,732 WARN [main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored 2019-05-08T12:47:50,732 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.schema.autoCreateAll value null from jpox.properties with false 2019-05-08T12:47:50,732 DEBUG [main] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionDriverName value null from jpox.properties with org.postgresql.Driver 2019-05-08T12:47:50,732 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.connectionPool.maxPoolSize value null from jpox.properties with 10 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.connectionPoolingType value null from jpox.properties with HikariCP 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionURL value null from jpox.properties with jdbc:postgresql://:5432/dpdl_metastore 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionUserName value null from jpox.properties with dpdl 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.autoStartMechanismMode value null from jpox.properties with ignored 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.cache.level2 value null from jpox.properties with false 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.cache.level2.type value null from jpox.properties with none 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.rdbms.initializeColumnInfo value null from jpox.properties with NONE 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.plugin.pluginRegistryBundleCheck value null from jpox.properties with LOG 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.transactionIsolation value null from jpox.properties with read-committed 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.rdbms.useLegacyNativeValueStrategy value null from jpox.properties with true 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding javax.jdo.option.DetachAllOnCommit value null from jpox.properties with true 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.identifierFactory value null from jpox.properties with datanucleus1 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding javax.jdo.PersistenceManagerFactoryClass value null from jpox.properties with org.datanucleus.api.jdo.JDOPersistenceManagerFactory 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding javax.jdo.option.Multithreaded value null from jpox.properties with true 2019-05-08T12:47:50,733 DEBUG [main] metastore.ObjectStore: Overriding javax.jdo.option.NonTransactionalRead value null from jpox.properties with true 2019-05-08T12:47:50,734 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.storeManagerType value null from jpox.properties with rdbms 2019-05-08T12:47:50,734 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.schema.validateColumns value null from jpox.properties with false 2019-05-08T12:47:50,734 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.schema.validateConstraints value null from jpox.properties with false 2019-05-08T12:47:50,734 DEBUG [main] metastore.ObjectStore: Overriding datanucleus.schema.validateTables value null from jpox.properties with false 2019-05-08T12:47:50,738 DEBUG [main] metastore.ObjectStore: datanucleus.schema.autoCreateAll = false 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.schema.validateTables = false 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.rdbms.useLegacyNativeValueStrategy = true 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.schema.validateColumns = false 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.connectionPool.maxPoolSize = 10 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.autoStartMechanismMode = ignored 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.rdbms.initializeColumnInfo = NONE 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: javax.jdo.option.Multithreaded = true 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.identifierFactory = datanucleus1 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.transactionIsolation = read-committed 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: javax.jdo.option.ConnectionURL = jdbc:postgresql://:5432/dpdl_metastore 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: javax.jdo.option.DetachAllOnCommit = true 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: javax.jdo.option.NonTransactionalRead = true 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.schema.validateConstraints = false 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: javax.jdo.option.ConnectionDriverName = org.postgresql.Driver 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: javax.jdo.option.ConnectionUserName = dpdl 2019-05-08T12:47:50,739 DEBUG [main] metastore.ObjectStore: datanucleus.cache.level2 = false 2019-05-08T12:47:50,740 DEBUG [main] metastore.ObjectStore: datanucleus.plugin.pluginRegistryBundleCheck = LOG 2019-05-08T12:47:50,740 DEBUG [main] metastore.ObjectStore: datanucleus.cache.level2.type = none 2019-05-08T12:47:50,740 DEBUG [main] metastore.ObjectStore: javax.jdo.PersistenceManagerFactoryClass = org.datanucleus.api.jdo.JDOPersistenceManagerFactory 2019-05-08T12:47:50,740 DEBUG [main] metastore.ObjectStore: datanucleus.storeManagerType = rdbms 2019-05-08T12:47:50,740 DEBUG [main] metastore.ObjectStore: datanucleus.connectionPoolingType = HikariCP 2019-05-08T12:47:50,740 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2b30b627, with PersistenceManager: null will be shutdown 2019-05-08T12:47:50,740 INFO [main] metastore.ObjectStore: ObjectStore, initialize called 2019-05-08T12:47:50,741 INFO [main] conf.MetastoreConf: Unable to find config file hive-site.xml 2019-05-08T12:47:50,741 INFO [main] conf.MetastoreConf: Found configuration file null 2019-05-08T12:47:50,741 INFO [main] conf.MetastoreConf: Unable to find config file hivemetastore-site.xml 2019-05-08T12:47:50,741 INFO [main] conf.MetastoreConf: Found configuration file null 2019-05-08T12:47:50,741 INFO [main] conf.MetastoreConf: Found configuration file file:/opt/apache-hive-metastore-3.0.0-bin/conf/metastore-site.xml 2019-05-08T12:47:50,765 DEBUG [main] datasource.HikariCPDataSourceProvider: Configuration requested hikaricp pooling, HikariCpDSProvider exiting 2019-05-08T12:47:50,766 DEBUG [main] datasource.BoneCPDataSourceProvider: Configuration requested hikaricp pooling, BoneCpDSProvider exiting 2019-05-08T12:47:51,129 DEBUG [main] hikari.HikariConfig: HikariPool-1 - configuration: 2019-05-08T12:47:51,135 DEBUG [main] hikari.HikariConfig: allowPoolSuspension.............false 2019-05-08T12:47:51,135 DEBUG [main] hikari.HikariConfig: autoCommit......................true 2019-05-08T12:47:51,135 DEBUG [main] hikari.HikariConfig: catalog.........................none 2019-05-08T12:47:51,135 DEBUG [main] hikari.HikariConfig: connectionInitSql...............none 2019-05-08T12:47:51,135 DEBUG [main] hikari.HikariConfig: connectionTestQuery.............none 2019-05-08T12:47:51,135 DEBUG [main] hikari.HikariConfig: connectionTimeout...............30000 2019-05-08T12:47:51,136 DEBUG [main] hikari.HikariConfig: dataSource......................none 2019-05-08T12:47:51,136 DEBUG [main] hikari.HikariConfig: dataSourceClassName.............none 2019-05-08T12:47:51,136 DEBUG [main] hikari.HikariConfig: dataSourceJNDI..................none 2019-05-08T12:47:51,136 DEBUG [main] hikari.HikariConfig: dataSourceProperties............{password=} 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: driverClassName................."org.postgresql.Driver" 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: healthCheckProperties...........{} 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: healthCheckRegistry.............none 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: idleTimeout.....................600000 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: initializationFailFast..........true 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: initializationFailTimeout.......1 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: isolateInternalQueries..........false 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: jdbc4ConnectionTest.............false 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: jdbcUrl........................."jdbc:postgresql://:5432/dpdl_metastore" 2019-05-08T12:47:51,137 DEBUG [main] hikari.HikariConfig: leakDetectionThreshold..........0 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: maxLifetime.....................1800000 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: maximumPoolSize.................10 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: metricRegistry..................none 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: metricsTrackerFactory...........none 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: minimumIdle.....................10 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: password........................ 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: poolName........................"HikariPool-1" 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: readOnly........................false 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: registerMbeans..................false 2019-05-08T12:47:51,138 DEBUG [main] hikari.HikariConfig: scheduledExecutor...............none 2019-05-08T12:47:51,139 DEBUG [main] hikari.HikariConfig: scheduledExecutorService........internal 2019-05-08T12:47:51,139 DEBUG [main] hikari.HikariConfig: threadFactory...................internal 2019-05-08T12:47:51,139 DEBUG [main] hikari.HikariConfig: transactionIsolation............default 2019-05-08T12:47:51,139 DEBUG [main] hikari.HikariConfig: username........................"dpdl" 2019-05-08T12:47:51,139 DEBUG [main] hikari.HikariConfig: validationTimeout...............5000 2019-05-08T12:47:51,144 INFO [main] hikari.HikariDataSource: HikariPool-1 - Starting... 2019-05-08T12:47:51,271 DEBUG [main] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:51,273 INFO [main] hikari.HikariDataSource: HikariPool-1 - Start completed. 2019-05-08T12:47:51,300 DEBUG [main] hikari.HikariConfig: HikariPool-2 - configuration: 2019-05-08T12:47:51,301 DEBUG [main] hikari.HikariConfig: allowPoolSuspension.............false 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: autoCommit......................true 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: catalog.........................none 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: connectionInitSql...............none 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: connectionTestQuery.............none 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: connectionTimeout...............30000 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: dataSource......................none 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: dataSourceClassName.............none 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: dataSourceJNDI..................none 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: dataSourceProperties............{password=} 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: driverClassName................."org.postgresql.Driver" 2019-05-08T12:47:51,302 DEBUG [main] hikari.HikariConfig: healthCheckProperties...........{} 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: healthCheckRegistry.............none 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: idleTimeout.....................600000 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: initializationFailFast..........true 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: initializationFailTimeout.......1 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: isolateInternalQueries..........false 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: jdbc4ConnectionTest.............false 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: jdbcUrl........................."jdbc:postgresql://:5432/dpdl_metastore" 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: leakDetectionThreshold..........0 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: maxLifetime.....................1800000 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: maximumPoolSize.................10 2019-05-08T12:47:51,303 DEBUG [main] hikari.HikariConfig: metricRegistry..................none 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: metricsTrackerFactory...........none 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: minimumIdle.....................10 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: password........................ 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: poolName........................"HikariPool-2" 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: readOnly........................false 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: registerMbeans..................false 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: scheduledExecutor...............none 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: scheduledExecutorService........internal 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: threadFactory...................internal 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: transactionIsolation............default 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: username........................"dpdl" 2019-05-08T12:47:51,304 DEBUG [main] hikari.HikariConfig: validationTimeout...............5000 2019-05-08T12:47:51,305 INFO [main] hikari.HikariDataSource: HikariPool-2 - Starting... 2019-05-08T12:47:51,316 DEBUG [main] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:51,316 INFO [main] hikari.HikariDataSource: HikariPool-2 - Start completed. 2019-05-08T12:47:51,374 DEBUG [HikariPool-1 housekeeper] pool.HikariPool: HikariPool-1 - Pool stats (total=1, active=0, idle=1, waiting=0) 2019-05-08T12:47:51,384 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@184680f6 2019-05-08T12:47:51,391 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@16816d8e 2019-05-08T12:47:51,399 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@12beeb86 2019-05-08T12:47:51,406 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@57bc67b5 2019-05-08T12:47:51,417 DEBUG [HikariPool-2 housekeeper] pool.HikariPool: HikariPool-2 - Pool stats (total=1, active=1, idle=0, waiting=0) 2019-05-08T12:47:51,419 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@7b511c84 2019-05-08T12:47:51,424 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@7f49b44b 2019-05-08T12:47:51,430 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@718e55d2 2019-05-08T12:47:51,435 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@66a1f37d 2019-05-08T12:47:51,441 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@3a6d6f4 2019-05-08T12:47:51,446 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@75b1df3b 2019-05-08T12:47:51,451 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@379398fa 2019-05-08T12:47:51,454 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@30b35fe9 2019-05-08T12:47:51,459 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@445507b0 2019-05-08T12:47:51,459 DEBUG [HikariPool-1 connection adder] pool.HikariPool: HikariPool-1 - After adding stats (total=10, active=0, idle=10, waiting=0) 2019-05-08T12:47:51,467 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@1c9ab12 2019-05-08T12:47:51,472 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@7a7af417 2019-05-08T12:47:51,482 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@509ca0a6 2019-05-08T12:47:51,492 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@543c73 2019-05-08T12:47:51,507 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - Added connection org.postgresql.jdbc.PgConnection@4c099650 2019-05-08T12:47:51,507 DEBUG [HikariPool-2 connection adder] pool.HikariPool: HikariPool-2 - After adding stats (total=10, active=1, idle=9, waiting=0) 2019-05-08T12:47:51,717 INFO [main] metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" 2019-05-08T12:47:51,739 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2b30b627, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@17873842 created in the thread with id: 1 2019-05-08T12:47:51,747 DEBUG [main] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:51,749 DEBUG [main] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:51,750 DEBUG [main] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:51,800 DEBUG [main] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:51,801 INFO [main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is POSTGRES 2019-05-08T12:47:51,802 INFO [main] metastore.ObjectStore: Initialized ObjectStore 2019-05-08T12:47:51,855 DEBUG [main] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getMSchemaVersion(ObjectStore.java:9487) org.apache.hadoop.hive.metastore.ObjectStore.getMetaStoreSchemaVersion(ObjectStore.java:9474) org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:9431) 2019-05-08T12:47:53,284 DEBUG [main] pool.PoolBase: HikariPool-2 - Reset (autoCommit, isolation) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:53,328 DEBUG [main] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getMSchemaVersion(ObjectStore.java:9500) org.apache.hadoop.hive.metastore.ObjectStore.getMetaStoreSchemaVersion(ObjectStore.java:9474) org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:9431) 2019-05-08T12:47:53,330 DEBUG [main] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:53,338 DEBUG [main] metastore.ObjectStore: Found expected HMS version of 3.1.0 2019-05-08T12:47:53,338 INFO [main] metastore.HiveMetaStore: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2b30b627 from thread id: 1 2019-05-08T12:47:53,338 DEBUG [main] metastore.ObjectStore: Fetching catalog hive 2019-05-08T12:47:53,338 DEBUG [main] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getMCatalog(ObjectStore.java:915) org.apache.hadoop.hive.metastore.ObjectStore.getCatalog(ObjectStore.java:862) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2019-05-08T12:47:53,362 DEBUG [main] pool.PoolBase: HikariPool-2 - Reset (autoCommit, isolation) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:53,374 DEBUG [main] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getMCatalog(ObjectStore.java:922) org.apache.hadoop.hive.metastore.ObjectStore.getCatalog(ObjectStore.java:862) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2019-05-08T12:47:53,374 DEBUG [main] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:53,375 DEBUG [main] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.start(ObjectStore.java:3727) org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:3697) org.apache.hadoop.hive.metastore.ObjectStore.getDatabaseInternal(ObjectStore.java:1029) 2019-05-08T12:47:53,479 DEBUG [main] metastore.MetaStoreDirectSql: getDatabase: directsql returning db default locn[hdfs://:8020/warehouse/tablespace/managed/hive] desc [Default Hive database] owner [public] ownertype [ROLE] 2019-05-08T12:47:53,479 DEBUG [main] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.commit(ObjectStore.java:3815) org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:3712) org.apache.hadoop.hive.metastore.ObjectStore.getDatabaseInternal(ObjectStore.java:1029) 2019-05-08T12:47:53,480 DEBUG [main] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:53,480 DEBUG [main] metastore.ObjectStore: db details for db default retrieved using SQL in 105.339949ms 2019-05-08T12:47:53,481 DEBUG [main] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5196) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:53,481 DEBUG [main] metastore.ObjectStore: Open transaction: count = 2, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getMRole(ObjectStore.java:5541) org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5197) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2019-05-08T12:47:53,490 DEBUG [main] pool.PoolBase: HikariPool-2 - Reset (autoCommit, isolation) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:53,494 DEBUG [main] metastore.ObjectStore: Commit transaction: count = 1, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getMRole(ObjectStore.java:5547) org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5197) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2019-05-08T12:47:53,495 DEBUG [main] metastore.ObjectStore: Rollback transaction, isActive: true at: org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5208) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:53,496 DEBUG [main] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:53,497 DEBUG [main] metastore.HiveMetaStore: admin role already exists org.apache.hadoop.hive.metastore.api.InvalidObjectException: Role admin already exists. at org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5199) ~[hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) ~[hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at com.sun.proxy.$Proxy32.addRole(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles_core(HiveMetaStore.java:817) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles(HiveMetaStore.java:806) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:541) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java:80) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:9132) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:9127) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:9400) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:9317) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.util.RunJar.run(RunJar.java:308) [hadoop-common-3.1.0.jar:?] at org.apache.hadoop.util.RunJar.main(RunJar.java:222) [hadoop-common-3.1.0.jar:?] 2019-05-08T12:47:53,501 INFO [main] metastore.HiveMetaStore: Added admin role in metastore 2019-05-08T12:47:53,501 DEBUG [main] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5196) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:53,501 DEBUG [main] metastore.ObjectStore: Open transaction: count = 2, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getMRole(ObjectStore.java:5541) org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5197) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2019-05-08T12:47:53,503 DEBUG [main] metastore.ObjectStore: Commit transaction: count = 1, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getMRole(ObjectStore.java:5547) org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5197) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2019-05-08T12:47:53,504 DEBUG [main] metastore.ObjectStore: Rollback transaction, isActive: true at: org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5208) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:53,504 DEBUG [main] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:53,504 DEBUG [main] metastore.HiveMetaStore: public role already exists org.apache.hadoop.hive.metastore.api.InvalidObjectException: Role public already exists. at org.apache.hadoop.hive.metastore.ObjectStore.addRole(ObjectStore.java:5199) ~[hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) ~[hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at com.sun.proxy.$Proxy32.addRole(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles_core(HiveMetaStore.java:826) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles(HiveMetaStore.java:806) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:541) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java:80) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:9132) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:9127) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:9400) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:9317) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.util.RunJar.run(RunJar.java:308) [hadoop-common-3.1.0.jar:?] at org.apache.hadoop.util.RunJar.main(RunJar.java:222) [hadoop-common-3.1.0.jar:?] 2019-05-08T12:47:53,505 INFO [main] metastore.HiveMetaStore: Added public role in metastore 2019-05-08T12:47:53,507 DEBUG [main] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.grantPrivileges(ObjectStore.java:5932) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:53,510 DEBUG [main] metastore.ObjectStore: Open transaction: count = 2, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getMRole(ObjectStore.java:5541) org.apache.hadoop.hive.metastore.ObjectStore.validateRole(ObjectStore.java:5257) org.apache.hadoop.hive.metastore.ObjectStore.grantPrivileges(ObjectStore.java:5954) 2019-05-08T12:47:53,511 DEBUG [main] metastore.ObjectStore: Commit transaction: count = 1, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getMRole(ObjectStore.java:5547) org.apache.hadoop.hive.metastore.ObjectStore.validateRole(ObjectStore.java:5257) org.apache.hadoop.hive.metastore.ObjectStore.grantPrivileges(ObjectStore.java:5954) 2019-05-08T12:47:53,512 DEBUG [main] metastore.ObjectStore: Open transaction: count = 2, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.listPrincipalMGlobalGrants(ObjectStore.java:6538) org.apache.hadoop.hive.metastore.ObjectStore.grantPrivileges(ObjectStore.java:5961) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2019-05-08T12:47:53,519 DEBUG [main] pool.PoolBase: HikariPool-2 - Reset (autoCommit, isolation) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:53,522 DEBUG [main] metastore.ObjectStore: Commit transaction: count = 1, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.listPrincipalMGlobalGrants(ObjectStore.java:6554) org.apache.hadoop.hive.metastore.ObjectStore.grantPrivileges(ObjectStore.java:5961) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2019-05-08T12:47:53,522 DEBUG [main] metastore.ObjectStore: Rollback transaction, isActive: true at: org.apache.hadoop.hive.metastore.ObjectStore.grantPrivileges(ObjectStore.java:6139) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:53,523 DEBUG [main] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:53,523 DEBUG [main] metastore.HiveMetaStore: Failed while granting global privs to admin org.apache.hadoop.hive.metastore.api.InvalidObjectException: All is already granted by admin at org.apache.hadoop.hive.metastore.ObjectStore.grantPrivileges(ObjectStore.java:5971) ~[hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) ~[hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at com.sun.proxy.$Proxy32.grantPrivileges(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles_core(HiveMetaStore.java:840) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultRoles(HiveMetaStore.java:806) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:541) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java:80) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:9132) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:9127) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:9400) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:9317) [hive-standalone-metastore-3.1.0.3.1.0.0-78.jar:3.1.0.3.1.0.0-78] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.apache.hadoop.util.RunJar.run(RunJar.java:308) [hadoop-common-3.1.0.jar:?] at org.apache.hadoop.util.RunJar.main(RunJar.java:222) [hadoop-common-3.1.0.jar:?] 2019-05-08T12:47:53,523 INFO [main] metastore.HiveMetaStore: No user is added in admin role, since config is empty 2019-05-08T12:47:53,526 DEBUG [main] metastore.ThreadPool: ThreadPool initialized 2019-05-08T12:47:53,542 DEBUG [main] metrics.PerfLogger: 2019-05-08T12:47:53,663 INFO [main] metastore.HiveMetaStore: Starting DB backed MetaStore Server with SetUGI enabled 2019-05-08T12:47:53,669 INFO [main] metastore.HiveMetaStore: Started the new metaserver on port [9083]... 2019-05-08T12:47:53,669 INFO [main] metastore.HiveMetaStore: Options.minWorkerThreads = 200 2019-05-08T12:47:53,669 INFO [main] metastore.HiveMetaStore: Options.maxWorkerThreads = 1000 2019-05-08T12:47:53,669 INFO [main] metastore.HiveMetaStore: TCP keepalive = true 2019-05-08T12:47:53,669 INFO [main] metastore.HiveMetaStore: Enable SSL = false 2019-05-08T12:47:55,367 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,368 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,369 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,371 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,372 INFO [pool-6-thread-1] metastore.HiveMetaStore: 1: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore 2019-05-08T12:47:55,372 WARN [pool-6-thread-1] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.schema.autoCreateAll value null from jpox.properties with false 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionDriverName value null from jpox.properties with org.postgresql.Driver 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.connectionPool.maxPoolSize value null from jpox.properties with 10 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.connectionPoolingType value null from jpox.properties with HikariCP 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionURL value null from jpox.properties with jdbc:postgresql://:5432/dpdl_metastore 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionUserName value null from jpox.properties with dpdl 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.autoStartMechanismMode value null from jpox.properties with ignored 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.cache.level2 value null from jpox.properties with false 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.cache.level2.type value null from jpox.properties with none 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.rdbms.initializeColumnInfo value null from jpox.properties with NONE 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.plugin.pluginRegistryBundleCheck value null from jpox.properties with LOG 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.transactionIsolation value null from jpox.properties with read-committed 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.rdbms.useLegacyNativeValueStrategy value null from jpox.properties with true 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding javax.jdo.option.DetachAllOnCommit value null from jpox.properties with true 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.identifierFactory value null from jpox.properties with datanucleus1 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding javax.jdo.PersistenceManagerFactoryClass value null from jpox.properties with org.datanucleus.api.jdo.JDOPersistenceManagerFactory 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding javax.jdo.option.Multithreaded value null from jpox.properties with true 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding javax.jdo.option.NonTransactionalRead value null from jpox.properties with true 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.storeManagerType value null from jpox.properties with rdbms 2019-05-08T12:47:55,373 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.schema.validateColumns value null from jpox.properties with false 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.schema.validateConstraints value null from jpox.properties with false 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: Overriding datanucleus.schema.validateTables value null from jpox.properties with false 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.schema.autoCreateAll = false 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.schema.validateTables = false 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.rdbms.useLegacyNativeValueStrategy = true 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.schema.validateColumns = false 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.connectionPool.maxPoolSize = 10 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.autoStartMechanismMode = ignored 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.rdbms.initializeColumnInfo = NONE 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: javax.jdo.option.Multithreaded = true 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.identifierFactory = datanucleus1 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.transactionIsolation = read-committed 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: javax.jdo.option.ConnectionURL = jdbc:postgresql://:5432/dpdl_metastore 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: javax.jdo.option.DetachAllOnCommit = true 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: javax.jdo.option.NonTransactionalRead = true 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.schema.validateConstraints = false 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: javax.jdo.option.ConnectionDriverName = org.postgresql.Driver 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: javax.jdo.option.ConnectionUserName = dpdl 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.cache.level2 = false 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.plugin.pluginRegistryBundleCheck = LOG 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.cache.level2.type = none 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: javax.jdo.PersistenceManagerFactoryClass = org.datanucleus.api.jdo.JDOPersistenceManagerFactory 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.storeManagerType = rdbms 2019-05-08T12:47:55,374 DEBUG [pool-6-thread-1] metastore.ObjectStore: datanucleus.connectionPoolingType = HikariCP 2019-05-08T12:47:55,375 INFO [pool-6-thread-1] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3f3b9156, with PersistenceManager: null will be shutdown 2019-05-08T12:47:55,375 INFO [pool-6-thread-1] metastore.ObjectStore: ObjectStore, initialize called 2019-05-08T12:47:55,375 INFO [pool-6-thread-1] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3f3b9156, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@108ca356 created in the thread with id: 21 2019-05-08T12:47:55,378 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:55,378 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:55,379 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:55,385 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:55,385 INFO [pool-6-thread-1] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is POSTGRES 2019-05-08T12:47:55,385 INFO [pool-6-thread-1] metastore.ObjectStore: Initialized ObjectStore 2019-05-08T12:47:55,386 INFO [pool-6-thread-1] metastore.HiveMetaStore: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3f3b9156 from thread id: 21 2019-05-08T12:47:55,386 DEBUG [pool-6-thread-1] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getCurrentNotificationEventId(ObjectStore.java:10054) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,391 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-2 - Reset (autoCommit, isolation) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:55,394 DEBUG [pool-6-thread-1] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getCurrentNotificationEventId(ObjectStore.java:10061) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,395 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:55,396 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,405 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,407 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,407 INFO [pool-6-thread-1] metastore.HiveMetaStore: 1: source: get_config_value: name=metastore.batch.retrieve.max defaultValue=50 2019-05-08T12:47:55,408 INFO [pool-6-thread-1] HiveMetaStore.audit: ugi=hive ip= cmd=source: get_config_value: name=metastore.batch.retrieve.max defaultValue=50 2019-05-08T12:47:55,408 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,409 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,410 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,411 DEBUG [pool-6-thread-1] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getNextNotification(ObjectStore.java:9831) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,417 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-2 - Reset (autoCommit, isolation) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:47:55,423 DEBUG [pool-6-thread-1] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getNextNotification(ObjectStore.java:9839) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,423 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:55,424 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,425 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,425 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,425 DEBUG [pool-6-thread-1] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getCurrentNotificationEventId(ObjectStore.java:10054) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,426 DEBUG [pool-6-thread-1] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getCurrentNotificationEventId(ObjectStore.java:10061) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,427 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:55,427 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,428 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,428 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,428 INFO [pool-6-thread-1] metastore.HiveMetaStore: 1: source: get_config_value: name=metastore.batch.retrieve.max defaultValue=50 2019-05-08T12:47:55,428 INFO [pool-6-thread-1] HiveMetaStore.audit: ugi=hive ip= cmd=source: get_config_value: name=metastore.batch.retrieve.max defaultValue=50 2019-05-08T12:47:55,428 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,429 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,429 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,429 DEBUG [pool-6-thread-1] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getNextNotification(ObjectStore.java:9831) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,431 DEBUG [pool-6-thread-1] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getNextNotification(ObjectStore.java:9839) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,431 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:55,431 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,432 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,432 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,432 DEBUG [pool-6-thread-1] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getCurrentNotificationEventId(ObjectStore.java:10054) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,434 DEBUG [pool-6-thread-1] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getCurrentNotificationEventId(ObjectStore.java:10061) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,434 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:55,435 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,435 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,435 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,435 INFO [pool-6-thread-1] metastore.HiveMetaStore: 1: source: get_config_value: name=metastore.batch.retrieve.max defaultValue=50 2019-05-08T12:47:55,435 INFO [pool-6-thread-1] HiveMetaStore.audit: ugi=hive ip= cmd=source: get_config_value: name=metastore.batch.retrieve.max defaultValue=50 2019-05-08T12:47:55,435 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,436 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:47:55,436 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:47:55,436 DEBUG [pool-6-thread-1] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getNextNotification(ObjectStore.java:9831) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,438 DEBUG [pool-6-thread-1] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getNextNotification(ObjectStore.java:9839) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:47:55,438 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:47:55,439 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:48:20,096 DEBUG [pool-6-thread-2] metrics.PerfLogger: 2019-05-08T12:48:20,096 DEBUG [pool-6-thread-2] metrics.PerfLogger: 2019-05-08T12:48:20,097 DEBUG [pool-6-thread-2] security.UserGroupInformation: PrivilegedAction as:spark (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:48:20,099 DEBUG [pool-6-thread-2] metrics.PerfLogger: 2019-05-08T12:48:20,099 INFO [pool-6-thread-2] metastore.HiveMetaStore: 2: source: get_database: @spark#default 2019-05-08T12:48:20,099 INFO [pool-6-thread-2] HiveMetaStore.audit: ugi=spark ip= cmd=source: get_database: @spark#default 2019-05-08T12:48:20,100 INFO [pool-6-thread-2] metastore.HiveMetaStore: 2: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore 2019-05-08T12:48:20,100 WARN [pool-6-thread-2] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.schema.autoCreateAll value null from jpox.properties with false 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionDriverName value null from jpox.properties with org.postgresql.Driver 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.connectionPool.maxPoolSize value null from jpox.properties with 10 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.connectionPoolingType value null from jpox.properties with HikariCP 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionURL value null from jpox.properties with jdbc:postgresql://:5432/dpdl_metastore 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionUserName value null from jpox.properties with dpdl 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.autoStartMechanismMode value null from jpox.properties with ignored 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.cache.level2 value null from jpox.properties with false 2019-05-08T12:48:20,100 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.cache.level2.type value null from jpox.properties with none 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.rdbms.initializeColumnInfo value null from jpox.properties with NONE 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.plugin.pluginRegistryBundleCheck value null from jpox.properties with LOG 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.transactionIsolation value null from jpox.properties with read-committed 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.rdbms.useLegacyNativeValueStrategy value null from jpox.properties with true 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding javax.jdo.option.DetachAllOnCommit value null from jpox.properties with true 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.identifierFactory value null from jpox.properties with datanucleus1 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding javax.jdo.PersistenceManagerFactoryClass value null from jpox.properties with org.datanucleus.api.jdo.JDOPersistenceManagerFactory 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding javax.jdo.option.Multithreaded value null from jpox.properties with true 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding javax.jdo.option.NonTransactionalRead value null from jpox.properties with true 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.storeManagerType value null from jpox.properties with rdbms 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.schema.validateColumns value null from jpox.properties with false 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.schema.validateConstraints value null from jpox.properties with false 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: Overriding datanucleus.schema.validateTables value null from jpox.properties with false 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.schema.autoCreateAll = false 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.schema.validateTables = false 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.rdbms.useLegacyNativeValueStrategy = true 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.schema.validateColumns = false 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.connectionPool.maxPoolSize = 10 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.autoStartMechanismMode = ignored 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.rdbms.initializeColumnInfo = NONE 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: javax.jdo.option.Multithreaded = true 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.identifierFactory = datanucleus1 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.transactionIsolation = read-committed 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: javax.jdo.option.ConnectionURL = jdbc:postgresql://:5432/dpdl_metastore 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: javax.jdo.option.DetachAllOnCommit = true 2019-05-08T12:48:20,101 DEBUG [pool-6-thread-2] metastore.ObjectStore: javax.jdo.option.NonTransactionalRead = true 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.schema.validateConstraints = false 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: javax.jdo.option.ConnectionDriverName = org.postgresql.Driver 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: javax.jdo.option.ConnectionUserName = dpdl 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.cache.level2 = false 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.plugin.pluginRegistryBundleCheck = LOG 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.cache.level2.type = none 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: javax.jdo.PersistenceManagerFactoryClass = org.datanucleus.api.jdo.JDOPersistenceManagerFactory 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.storeManagerType = rdbms 2019-05-08T12:48:20,102 DEBUG [pool-6-thread-2] metastore.ObjectStore: datanucleus.connectionPoolingType = HikariCP 2019-05-08T12:48:20,102 INFO [pool-6-thread-2] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@4b04a275, with PersistenceManager: null will be shutdown 2019-05-08T12:48:20,102 INFO [pool-6-thread-2] metastore.ObjectStore: ObjectStore, initialize called 2019-05-08T12:48:20,102 INFO [pool-6-thread-2] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@4b04a275, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@6bc2ce5f created in the thread with id: 22 2019-05-08T12:48:20,107 DEBUG [pool-6-thread-2] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:48:20,108 DEBUG [pool-6-thread-2] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:48:20,109 DEBUG [pool-6-thread-2] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:48:20,115 DEBUG [pool-6-thread-2] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:48:20,115 INFO [pool-6-thread-2] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is POSTGRES 2019-05-08T12:48:20,116 INFO [pool-6-thread-2] metastore.ObjectStore: Initialized ObjectStore 2019-05-08T12:48:20,116 INFO [pool-6-thread-2] metastore.HiveMetaStore: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@4b04a275 from thread id: 22 2019-05-08T12:48:20,116 DEBUG [pool-6-thread-2] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.start(ObjectStore.java:3727) org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:3697) org.apache.hadoop.hive.metastore.ObjectStore.getDatabaseInternal(ObjectStore.java:1029) 2019-05-08T12:48:20,118 DEBUG [pool-6-thread-2] metastore.MetaStoreDirectSql: getDatabase: directsql returning db default locn[file:/apps/spark/warehouse] desc [default database] owner [null] ownertype [USER] 2019-05-08T12:48:20,118 DEBUG [pool-6-thread-2] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.commit(ObjectStore.java:3815) org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:3712) org.apache.hadoop.hive.metastore.ObjectStore.getDatabaseInternal(ObjectStore.java:1029) 2019-05-08T12:48:20,119 DEBUG [pool-6-thread-2] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:48:20,119 DEBUG [pool-6-thread-2] metastore.ObjectStore: db details for db default retrieved using SQL in 3.385608ms 2019-05-08T12:48:20,120 DEBUG [pool-6-thread-2] metrics.PerfLogger: 2019-05-08T12:48:21,376 DEBUG [HikariPool-1 housekeeper] pool.HikariPool: HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0) 2019-05-08T12:48:21,417 DEBUG [HikariPool-2 housekeeper] pool.HikariPool: HikariPool-2 - Pool stats (total=10, active=0, idle=10, waiting=0) 2019-05-08T12:48:34,077 DEBUG [pool-6-thread-3] metrics.PerfLogger: 2019-05-08T12:48:34,077 DEBUG [pool-6-thread-3] metrics.PerfLogger: 2019-05-08T12:48:34,078 DEBUG [pool-6-thread-3] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:48:34,078 DEBUG [pool-6-thread-3] metrics.PerfLogger: 2019-05-08T12:48:34,078 INFO [pool-6-thread-3] metastore.HiveMetaStore: 3: source: get_database: @hive#default 2019-05-08T12:48:34,078 INFO [pool-6-thread-3] HiveMetaStore.audit: ugi=hive ip= cmd=source: get_database: @hive#default 2019-05-08T12:48:34,079 INFO [pool-6-thread-3] metastore.HiveMetaStore: 3: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore 2019-05-08T12:48:34,079 WARN [pool-6-thread-3] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored 2019-05-08T12:48:34,079 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.schema.autoCreateAll value null from jpox.properties with false 2019-05-08T12:48:34,079 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionDriverName value null from jpox.properties with org.postgresql.Driver 2019-05-08T12:48:34,079 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.connectionPool.maxPoolSize value null from jpox.properties with 10 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.connectionPoolingType value null from jpox.properties with HikariCP 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionURL value null from jpox.properties with jdbc:postgresql://:5432/dpdl_metastore 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding javax.jdo.option.ConnectionUserName value null from jpox.properties with dpdl 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.autoStartMechanismMode value null from jpox.properties with ignored 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.cache.level2 value null from jpox.properties with false 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.cache.level2.type value null from jpox.properties with none 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.rdbms.initializeColumnInfo value null from jpox.properties with NONE 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.plugin.pluginRegistryBundleCheck value null from jpox.properties with LOG 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.transactionIsolation value null from jpox.properties with read-committed 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.rdbms.useLegacyNativeValueStrategy value null from jpox.properties with true 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding javax.jdo.option.DetachAllOnCommit value null from jpox.properties with true 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.identifierFactory value null from jpox.properties with datanucleus1 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding javax.jdo.PersistenceManagerFactoryClass value null from jpox.properties with org.datanucleus.api.jdo.JDOPersistenceManagerFactory 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding javax.jdo.option.Multithreaded value null from jpox.properties with true 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding javax.jdo.option.NonTransactionalRead value null from jpox.properties with true 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.storeManagerType value null from jpox.properties with rdbms 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.schema.validateColumns value null from jpox.properties with false 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.schema.validateConstraints value null from jpox.properties with false 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: Overriding datanucleus.schema.validateTables value null from jpox.properties with false 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.schema.autoCreateAll = false 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.schema.validateTables = false 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.rdbms.useLegacyNativeValueStrategy = true 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.schema.validateColumns = false 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.connectionPool.maxPoolSize = 10 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.autoStartMechanismMode = ignored 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.rdbms.initializeColumnInfo = NONE 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: javax.jdo.option.Multithreaded = true 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.identifierFactory = datanucleus1 2019-05-08T12:48:34,080 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.transactionIsolation = read-committed 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: javax.jdo.option.ConnectionURL = jdbc:postgresql://:5432/dpdl_metastore 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: javax.jdo.option.DetachAllOnCommit = true 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: javax.jdo.option.NonTransactionalRead = true 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.schema.validateConstraints = false 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: javax.jdo.option.ConnectionDriverName = org.postgresql.Driver 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: javax.jdo.option.ConnectionUserName = dpdl 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.cache.level2 = false 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.plugin.pluginRegistryBundleCheck = LOG 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.cache.level2.type = none 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: javax.jdo.PersistenceManagerFactoryClass = org.datanucleus.api.jdo.JDOPersistenceManagerFactory 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.storeManagerType = rdbms 2019-05-08T12:48:34,081 DEBUG [pool-6-thread-3] metastore.ObjectStore: datanucleus.connectionPoolingType = HikariCP 2019-05-08T12:48:34,081 INFO [pool-6-thread-3] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2ef7d84e, with PersistenceManager: null will be shutdown 2019-05-08T12:48:34,085 INFO [pool-6-thread-3] metastore.ObjectStore: ObjectStore, initialize called 2019-05-08T12:48:34,085 INFO [pool-6-thread-3] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2ef7d84e, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@26f341a4 created in the thread with id: 23 2019-05-08T12:48:34,086 DEBUG [pool-6-thread-3] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:48:34,087 DEBUG [pool-6-thread-3] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:48:34,088 DEBUG [pool-6-thread-3] pool.PoolBase: HikariPool-2 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1e366f0f 2019-05-08T12:48:34,091 DEBUG [pool-6-thread-3] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:48:34,091 INFO [pool-6-thread-3] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is POSTGRES 2019-05-08T12:48:34,091 INFO [pool-6-thread-3] metastore.ObjectStore: Initialized ObjectStore 2019-05-08T12:48:34,091 INFO [pool-6-thread-3] metastore.HiveMetaStore: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2ef7d84e from thread id: 23 2019-05-08T12:48:34,092 DEBUG [pool-6-thread-3] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.start(ObjectStore.java:3727) org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:3697) org.apache.hadoop.hive.metastore.ObjectStore.getDatabaseInternal(ObjectStore.java:1029) 2019-05-08T12:48:34,094 DEBUG [pool-6-thread-3] metastore.MetaStoreDirectSql: getDatabase: directsql returning db default locn[hdfs://:8020/warehouse/tablespace/managed/hive] desc [Default Hive database] owner [public] ownertype [ROLE] 2019-05-08T12:48:34,094 DEBUG [pool-6-thread-3] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.commit(ObjectStore.java:3815) org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:3712) org.apache.hadoop.hive.metastore.ObjectStore.getDatabaseInternal(ObjectStore.java:1029) 2019-05-08T12:48:34,095 DEBUG [pool-6-thread-3] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:48:34,095 DEBUG [pool-6-thread-3] metastore.ObjectStore: db details for db default retrieved using SQL in 3.274732ms 2019-05-08T12:48:34,095 DEBUG [pool-6-thread-3] metrics.PerfLogger: 2019-05-08T12:48:35,333 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:48:35,333 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:48:35,334 DEBUG [pool-6-thread-1] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getCurrentNotificationEventId(ObjectStore.java:10054) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:48:35,336 DEBUG [pool-6-thread-1] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getCurrentNotificationEventId(ObjectStore.java:10061) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:48:35,337 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:48:35,337 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:48:35,338 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:48:35,338 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:48:35,338 INFO [pool-6-thread-1] metastore.HiveMetaStore: 1: source: get_config_value: name=metastore.batch.retrieve.max defaultValue=50 2019-05-08T12:48:35,338 INFO [pool-6-thread-1] HiveMetaStore.audit: ugi=hive ip= cmd=source: get_config_value: name=metastore.batch.retrieve.max defaultValue=50 2019-05-08T12:48:35,338 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:48:35,339 DEBUG [pool-6-thread-1] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:48:35,339 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:48:35,339 DEBUG [pool-6-thread-1] metastore.ObjectStore: Open transaction: count = 1, isActive = true at: org.apache.hadoop.hive.metastore.ObjectStore.getNextNotification(ObjectStore.java:9831) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:48:35,341 DEBUG [pool-6-thread-1] metastore.ObjectStore: Commit transaction: count = 0, isactive true at: org.apache.hadoop.hive.metastore.ObjectStore.getNextNotification(ObjectStore.java:9839) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2019-05-08T12:48:35,341 DEBUG [pool-6-thread-1] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@3555d804 2019-05-08T12:48:35,341 DEBUG [pool-6-thread-1] metrics.PerfLogger: 2019-05-08T12:48:37,175 DEBUG [pool-6-thread-3] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:48:37,176 DEBUG [pool-6-thread-3] metrics.PerfLogger: 2019-05-08T12:48:37,177 DEBUG [pool-6-thread-3] metrics.PerfLogger: 2019-05-08T12:48:37,178 DEBUG [pool-6-thread-3] security.UserGroupInformation: PrivilegedAction as:hive (auth:SIMPLE) from:org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119) 2019-05-08T12:48:37,180 DEBUG [pool-6-thread-3] metrics.PerfLogger: 2019-05-08T12:48:37,200 DEBUG [pool-6-thread-3] datasource.HikariCPDataSourceProvider: Creating Hikari connection pool for the MetaStore 2019-05-08T12:48:37,205 DEBUG [pool-6-thread-3] hikari.HikariConfig: HikariPool-3 - configuration: 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: allowPoolSuspension.............false 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: autoCommit......................true 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: catalog.........................none 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: connectionInitSql...............none 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: connectionTestQuery.............none 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: connectionTimeout...............30000 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: dataSource......................none 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: dataSourceClassName.............none 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: dataSourceJNDI..................none 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: dataSourceProperties............{password=} 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: driverClassName.................none 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: healthCheckProperties...........{} 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: healthCheckRegistry.............none 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: idleTimeout.....................600000 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: initializationFailFast..........true 2019-05-08T12:48:37,206 DEBUG [pool-6-thread-3] hikari.HikariConfig: initializationFailTimeout.......1 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: isolateInternalQueries..........false 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: jdbc4ConnectionTest.............false 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: jdbcUrl........................."jdbc:postgresql://:5432/dpdl_metastore" 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: leakDetectionThreshold..........0 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: maxLifetime.....................1800000 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: maximumPoolSize.................10 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: metricRegistry..................none 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: metricsTrackerFactory...........none 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: minimumIdle.....................10 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: password........................ 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: poolName........................"HikariPool-3" 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: readOnly........................false 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: registerMbeans..................false 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: scheduledExecutor...............none 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: scheduledExecutorService........internal 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: threadFactory...................internal 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: transactionIsolation............default 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: username........................"dpdl" 2019-05-08T12:48:37,207 DEBUG [pool-6-thread-3] hikari.HikariConfig: validationTimeout...............5000 2019-05-08T12:48:37,208 INFO [pool-6-thread-3] hikari.HikariDataSource: HikariPool-3 - Starting... 2019-05-08T12:48:37,228 DEBUG [pool-6-thread-3] pool.HikariPool: HikariPool-3 - Added connection org.postgresql.jdbc.PgConnection@ee28852 2019-05-08T12:48:37,229 INFO [pool-6-thread-3] hikari.HikariDataSource: HikariPool-3 - Start completed. 2019-05-08T12:48:37,229 DEBUG [pool-6-thread-3] datasource.HikariCPDataSourceProvider: Creating Hikari connection pool for the MetaStore 2019-05-08T12:48:37,230 DEBUG [pool-6-thread-3] hikari.HikariConfig: HikariPool-4 - configuration: 2019-05-08T12:48:37,230 DEBUG [pool-6-thread-3] hikari.HikariConfig: allowPoolSuspension.............false 2019-05-08T12:48:37,230 DEBUG [pool-6-thread-3] hikari.HikariConfig: autoCommit......................true 2019-05-08T12:48:37,230 DEBUG [pool-6-thread-3] hikari.HikariConfig: catalog.........................none 2019-05-08T12:48:37,230 DEBUG [pool-6-thread-3] hikari.HikariConfig: connectionInitSql...............none 2019-05-08T12:48:37,230 DEBUG [pool-6-thread-3] hikari.HikariConfig: connectionTestQuery.............none 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: connectionTimeout...............30000 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: dataSource......................none 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: dataSourceClassName.............none 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: dataSourceJNDI..................none 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: dataSourceProperties............{password=} 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: driverClassName.................none 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: healthCheckProperties...........{} 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: healthCheckRegistry.............none 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: idleTimeout.....................600000 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: initializationFailFast..........true 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: initializationFailTimeout.......1 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: isolateInternalQueries..........false 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: jdbc4ConnectionTest.............false 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: jdbcUrl........................."jdbc:postgresql://:5432/dpdl_metastore" 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: leakDetectionThreshold..........0 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: maxLifetime.....................1800000 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: maximumPoolSize.................10 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: metricRegistry..................none 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: metricsTrackerFactory...........none 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: minimumIdle.....................10 2019-05-08T12:48:37,231 DEBUG [pool-6-thread-3] hikari.HikariConfig: password........................ 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: poolName........................"HikariPool-4" 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: readOnly........................false 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: registerMbeans..................false 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: scheduledExecutor...............none 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: scheduledExecutorService........internal 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: threadFactory...................internal 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: transactionIsolation............default 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: username........................"dpdl" 2019-05-08T12:48:37,232 DEBUG [pool-6-thread-3] hikari.HikariConfig: validationTimeout...............5000 2019-05-08T12:48:37,232 INFO [pool-6-thread-3] hikari.HikariDataSource: HikariPool-4 - Starting... 2019-05-08T12:48:37,241 DEBUG [pool-6-thread-3] pool.HikariPool: HikariPool-4 - Added connection org.postgresql.jdbc.PgConnection@51f32a93 2019-05-08T12:48:37,242 INFO [pool-6-thread-3] hikari.HikariDataSource: HikariPool-4 - Start completed. 2019-05-08T12:48:37,242 DEBUG [pool-6-thread-3] pool.PoolBase: HikariPool-3 - Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@ee28852 2019-05-08T12:48:37,245 DEBUG [pool-6-thread-3] txn.TxnHandler: Going to execute query 2019-05-08T12:48:37,250 DEBUG [pool-6-thread-3] txn.TxnHandler: Going to execute query 2019-05-08T12:48:37,266 DEBUG [pool-6-thread-3] txn.TxnHandler: Going to execute query