2016-09-29 00:01:37,956 INFO [HiveServer2-Handler-Pool: Thread-7265]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V7 2016-09-29 00:01:37,958 INFO [HiveServer2-Handler-Pool: Thread-7265]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:01:37,962 INFO [HiveServer2-Handler-Pool: Thread-7265]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:01:37,962 INFO [HiveServer2-Handler-Pool: Thread-7265]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:01:37,962 INFO [HiveServer2-Handler-Pool: Thread-7265]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:01:37,985 INFO [HiveServer2-Handler-Pool: Thread-7265]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:01:37,985 WARN [HiveServer2-Handler-Pool: Thread-7265]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:01:37,985 WARN [HiveServer2-Handler-Pool: Thread-7265]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:01:37,985 WARN [HiveServer2-Handler-Pool: Thread-7265]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:01:38,045 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/f0b97532-4bb8-4ae6-a117-f5aad43f7ed7_resources 2016-09-29 00:01:38,075 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/f0b97532-4bb8-4ae6-a117-f5aad43f7ed7 2016-09-29 00:01:38,079 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/f0b97532-4bb8-4ae6-a117-f5aad43f7ed7 2016-09-29 00:01:38,109 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-09-29 00:01:38,129 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:01:38,129 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:newRawStore(665)) - 2175: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 2016-09-29 00:01:38,129 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:01:38,109 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/f0b97532-4bb8-4ae6-a117-f5aad43f7ed7/_tmp_space.db 2016-09-29 00:01:38,131 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/f0b97532-4bb8-4ae6-a117-f5aad43f7ed7 2016-09-29 00:01:38,134 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:01:38,134 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:01:38,138 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:01:38,138 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:01:38,138 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:01:38,138 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:01:38,218 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/ba8bebff-3f97-48b7-b340-448b4a1d88cb_resources 2016-09-29 00:01:38,222 ERROR [HiveServer2-Handler-Pool: Thread-7265]: server.TThreadPoolServer (TThreadPoolServer.java:run(295)) - Thrift error occurred during processing of message. org.apache.thrift.protocol.TProtocolException: Negative length: -2147418111 at org.apache.thrift.protocol.TBinaryProtocol.checkStringReadLength(TBinaryProtocol.java:408) at org.apache.thrift.protocol.TBinaryProtocol.readString(TBinaryProtocol.java:358) at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2016-09-29 00:01:38,222 INFO [HiveServer2-Handler-Pool: Thread-7265]: thrift.ThriftCLIService (ThriftCLIService.java:deleteContext(137)) - Session disconnected without closing properly, close it now 2016-09-29 00:01:38,222 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to f0b97532-4bb8-4ae6-a117-f5aad43f7ed7 for thread HiveServer2-Handler-Pool: Thread-7265 2016-09-29 00:01:38,222 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-7265 2016-09-29 00:01:38,222 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to f0b97532-4bb8-4ae6-a117-f5aad43f7ed7 for thread HiveServer2-Handler-Pool: Thread-7265 2016-09-29 00:01:38,239 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/ba8bebff-3f97-48b7-b340-448b4a1d88cb 2016-09-29 00:01:38,250 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/ba8bebff-3f97-48b7-b340-448b4a1d88cb 2016-09-29 00:01:38,250 INFO [HiveServer2-Handler-Pool: Thread-7265]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-7265 2016-09-29 00:01:38,268 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/ba8bebff-3f97-48b7-b340-448b4a1d88cb/_tmp_space.db 2016-09-29 00:01:38,300 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/ba8bebff-3f97-48b7-b340-448b4a1d88cb 2016-09-29 00:01:38,452 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to ba8bebff-3f97-48b7-b340-448b4a1d88cb for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:01:38,452 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:01:38,469 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to ba8bebff-3f97-48b7-b340-448b4a1d88cb for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:01:38,470 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:01:38,500 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to ba8bebff-3f97-48b7-b340-448b4a1d88cb for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:01:38,500 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:01:38,500 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to ba8bebff-3f97-48b7-b340-448b4a1d88cb for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:01:38,520 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:04:37,966 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-09-29 00:04:37,967 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:04:37,971 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:04:37,971 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:04:37,971 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:04:37,974 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:04:37,974 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:04:37,974 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:04:37,974 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:04:37,984 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/4cfc9022-240c-44f0-9dde-1aedb72bacec_resources 2016-09-29 00:04:38,010 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/4cfc9022-240c-44f0-9dde-1aedb72bacec 2016-09-29 00:04:38,017 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/4cfc9022-240c-44f0-9dde-1aedb72bacec 2016-09-29 00:04:38,038 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/4cfc9022-240c-44f0-9dde-1aedb72bacec/_tmp_space.db 2016-09-29 00:04:38,040 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/4cfc9022-240c-44f0-9dde-1aedb72bacec 2016-09-29 00:04:38,289 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 4cfc9022-240c-44f0-9dde-1aedb72bacec for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:04:38,289 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:04:38,307 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 4cfc9022-240c-44f0-9dde-1aedb72bacec for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:04:38,307 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:04:38,362 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 4cfc9022-240c-44f0-9dde-1aedb72bacec for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:04:38,362 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:04:38,362 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 4cfc9022-240c-44f0-9dde-1aedb72bacec for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:04:38,384 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:07:37,767 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-09-29 00:07:37,768 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:07:37,795 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:07:37,795 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:07:37,795 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:07:37,798 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:07:37,798 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:07:37,798 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:07:37,798 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:07:37,896 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/b434a539-8810-4a74-8431-c72b0844d334_resources 2016-09-29 00:07:37,937 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/b434a539-8810-4a74-8431-c72b0844d334 2016-09-29 00:07:37,939 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/b434a539-8810-4a74-8431-c72b0844d334 2016-09-29 00:07:37,964 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/b434a539-8810-4a74-8431-c72b0844d334/_tmp_space.db 2016-09-29 00:07:37,975 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/b434a539-8810-4a74-8431-c72b0844d334 2016-09-29 00:07:38,179 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to b434a539-8810-4a74-8431-c72b0844d334 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:07:38,179 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:07:38,225 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to b434a539-8810-4a74-8431-c72b0844d334 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:07:38,225 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:07:38,292 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to b434a539-8810-4a74-8431-c72b0844d334 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:07:38,292 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:07:38,292 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to b434a539-8810-4a74-8431-c72b0844d334 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:07:38,310 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:10:37,888 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-09-29 00:10:37,889 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:10:37,893 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:10:37,893 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:10:37,893 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:10:37,896 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:10:37,896 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:10:37,896 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:10:37,896 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:10:37,992 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/2dbe443b-1322-4055-8ed1-a1e4956110d4_resources 2016-09-29 00:10:38,012 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/2dbe443b-1322-4055-8ed1-a1e4956110d4 2016-09-29 00:10:38,014 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/2dbe443b-1322-4055-8ed1-a1e4956110d4 2016-09-29 00:10:38,045 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/2dbe443b-1322-4055-8ed1-a1e4956110d4/_tmp_space.db 2016-09-29 00:10:38,057 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/2dbe443b-1322-4055-8ed1-a1e4956110d4 2016-09-29 00:10:38,236 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 2dbe443b-1322-4055-8ed1-a1e4956110d4 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:10:38,237 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:10:38,269 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 2dbe443b-1322-4055-8ed1-a1e4956110d4 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:10:38,269 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:10:38,332 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 2dbe443b-1322-4055-8ed1-a1e4956110d4 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:10:38,332 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:10:38,332 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 2dbe443b-1322-4055-8ed1-a1e4956110d4 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:10:38,343 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:12:45,978 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V7 2016-09-29 00:12:45,980 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:12:45,983 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:12:45,983 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:12:45,983 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:12:45,985 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:12:45,985 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:12:45,985 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:12:45,985 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:12:45,989 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/fec76346-1ea4-4f37-85b1-4fcf442be39d_resources 2016-09-29 00:12:46,012 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d 2016-09-29 00:12:46,013 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/fec76346-1ea4-4f37-85b1-4fcf442be39d 2016-09-29 00:12:46,025 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/_tmp_space.db 2016-09-29 00:12:46,026 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/fec76346-1ea4-4f37-85b1-4fcf442be39d 2016-09-29 00:12:46,124 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:12:46,124 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:12:46,124 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:12:46,125 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Driver (Driver.java:compile(426)) - We are setting the hadoop caller context from HIVE_SSN_ID:fec76346-1ea4-4f37-85b1-4fcf442be39d to hive_20160929001246_f884029f-a16f-4ed6-a46a-5c9be5fe214e 2016-09-29 00:12:46,125 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:12:46,125 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: SELECT * FROM soilsensor2 order by timedate LIMIT 5 2016-09-29 00:12:46,125 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-09-29 00:12:46,125 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:12:46,125 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:12:46,126 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10390)) - Starting Semantic Analysis 2016-09-29 00:12:46,126 INFO [HiveServer2-Handler-Pool: Thread-18366]: sqlstd.SQLStdHiveAccessController (SQLStdHiveAccessController.java:(95)) - Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=fec76346-1ea4-4f37-85b1-4fcf442be39d, clientType=HIVESERVER2] 2016-09-29 00:12:46,126 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10337)) - Completed phase 1 of Semantic Analysis 2016-09-29 00:12:46,126 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1587)) - Get metadata for source tables 2016-09-29 00:12:46,126 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 2175: get_table : db=default tbl=soilsensor2 2016-09-29 00:12:46,126 INFO [HiveServer2-Handler-Pool: Thread-18366]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=anonymous ip=unknown-ip-addr cmd=get_table : db=default tbl=soilsensor2 2016-09-29 00:12:46,135 INFO [HiveServer2-Handler-Pool: Thread-18366]: metadata.HiveUtils (HiveUtils.java:getMetaStoreAuthorizeProviderManagers(355)) - Adding metastore authorization provider: org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider 2016-09-29 00:12:46,137 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1743)) - Get metadata for subqueries 2016-09-29 00:12:46,137 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1767)) - Get metadata for destination tables 2016-09-29 00:12:46,137 ERROR [HiveServer2-Handler-Pool: Thread-18366]: hdfs.KeyProviderCache (KeyProviderCache.java:createKeyProviderURI(87)) - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !! 2016-09-29 00:12:46,155 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Context (Context.java:getMRScratchDir(336)) - New scratch dir is hdfs://xxxxxxxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-12-46_125_3821666619784721761-296 2016-09-29 00:12:46,155 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10341)) - Completed getting MetaData in Semantic Analysis 2016-09-29 00:12:46,155 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.BaseSemanticAnalyzer (CalcitePlanner.java:canCBOHandleAst(397)) - Not invoking CBO because the statement has too few joins 2016-09-29 00:12:46,156 INFO [HiveServer2-Handler-Pool: Thread-18366]: common.FileUtils (FileUtils.java:mkdir(519)) - Creating directory if it doesn't exist: hdfs://xxxxxxxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-12-46_125_3821666619784721761-296/-mr-10000/.hive-staging_hive_2016-09-29_00-12-46_125_3821666619784721761-296 2016-09-29 00:12:46,211 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(694)) - Processing for FS(2933) 2016-09-29 00:12:46,211 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(694)) - Processing for SEL(2931) 2016-09-29 00:12:46,212 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(694)) - Processing for RS(2930) 2016-09-29 00:12:46,212 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(694)) - Processing for SEL(2929) 2016-09-29 00:12:46,212 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(413)) - Processing for TS(2928) 2016-09-29 00:12:46,212 INFO [HiveServer2-Handler-Pool: Thread-18366]: optimizer.ColumnPrunerProcFactory (ColumnPrunerProcFactory.java:pruneReduceSinkOperator(866)) - RS 2930 oldColExprMap: {VALUE._col2=Column[_col2], VALUE._col3=Column[_col3], VALUE._col0=Column[_col0], VALUE._col1=Column[_col1], KEY.reducesinkkey0=Column[_col4]} 2016-09-29 00:12:46,212 INFO [HiveServer2-Handler-Pool: Thread-18366]: optimizer.ColumnPrunerProcFactory (ColumnPrunerProcFactory.java:pruneReduceSinkOperator(915)) - RS 2930 newColExprMap: {VALUE._col2=Column[_col2], VALUE._col3=Column[_col3], VALUE._col0=Column[_col0], VALUE._col1=Column[_col1], KEY.reducesinkkey0=Column[_col4]} 2016-09-29 00:12:46,212 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:12:46,213 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:12:46,213 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 2175: get_table_statistics_req: db=default table=soilsensor2 2016-09-29 00:12:46,213 INFO [HiveServer2-Handler-Pool: Thread-18366]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=anonymous ip=unknown-ip-addr cmd=get_table_statistics_req: db=default table=soilsensor2 2016-09-29 00:12:46,221 INFO [HiveServer2-Handler-Pool: Thread-18366]: optimizer.SetReducerParallelism (SetReducerParallelism.java:process(108)) - Number of reducers determined to be: 1 2016-09-29 00:12:46,221 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(157)) - Cycle free: true 2016-09-29 00:12:46,222 INFO [HiveServer2-Handler-Pool: Thread-18366]: physical.Vectorizer (Vectorizer.java:validateMapWork(648)) - Validating MapWork... 2016-09-29 00:12:46,222 INFO [HiveServer2-Handler-Pool: Thread-18366]: physical.Vectorizer (Vectorizer.java:verifyAndSetVectorPartDesc(498)) - The input format org.apache.hadoop.mapred.TextInputFormat of path hdfs://xxxxxxx:8020/apps/hive/warehouse/soilsensor2 doesn't provide vectorized input 2016-09-29 00:12:46,222 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10495)) - Completed plan generation 2016-09-29 00:12:46,222 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Driver (Driver.java:compile(476)) - Semantic Analysis Completed 2016-09-29 00:12:46,222 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:12:46,223 INFO [HiveServer2-Handler-Pool: Thread-18366]: exec.ListSinkOperator (Operator.java:initialize(333)) - Initializing operator OP[2934] 2016-09-29 00:12:46,223 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Driver (Driver.java:getSchema(252)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:soilsensor2.macaddress, type:string, comment:null), FieldSchema(name:soilsensor2.sensorid, type:string, comment:null), FieldSchema(name:soilsensor2.sensorname, type:string, comment:null), FieldSchema(name:soilsensor2.sensorvalue, type:double, comment:null), FieldSchema(name:soilsensor2.timedate, type:string, comment:null)], properties:null) 2016-09-29 00:12:46,223 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:12:46,223 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Driver (Driver.java:compile(558)) - We are resetting the hadoop caller context to HIVE_SSN_ID:fec76346-1ea4-4f37-85b1-4fcf442be39d 2016-09-29 00:12:46,223 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:12:46,224 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (Driver.java:checkConcurrency(172)) - Concurrency mode is disabled, not creating a lock manager 2016-09-29 00:12:46,224 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:12:46,224 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (Driver.java:execute(1406)) - Setting caller context to query id hive_20160929001246_f884029f-a16f-4ed6-a46a-5c9be5fe214e 2016-09-29 00:12:46,224 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (Driver.java:execute(1409)) - Starting command(queryId=hive_20160929001246_f884029f-a16f-4ed6-a46a-5c9be5fe214e): SELECT * FROM soilsensor2 order by timedate LIMIT 5 2016-09-29 00:12:46,225 INFO [HiveServer2-Background-Pool: Thread-18397]: hooks.ATSHook (ATSHook.java:(90)) - Created ATS Hook 2016-09-29 00:12:46,225 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:12:46,225 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:12:46,225 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (SessionState.java:printInfo(939)) - Query ID = hive_20160929001246_f884029f-a16f-4ed6-a46a-5c9be5fe214e 2016-09-29 00:12:46,225 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (SessionState.java:printInfo(939)) - Total jobs = 1 2016-09-29 00:12:46,225 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:12:46,225 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (SessionState.java:printInfo(939)) - Launching Job 1 out of 1 2016-09-29 00:12:46,226 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (Driver.java:launchTask(1743)) - Starting task [Stage-1:MAPRED] in serial mode 2016-09-29 00:12:46,226 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.TezSessionPoolManager (TezSessionPoolManager.java:getSession(132)) - QueueName: null nonDefaultUser: true defaultQueuePool: [org.apache.hadoop.hive.ql.exec.tez.TezSessionState@7b3c4fc4] blockingQueueLength: 1 2016-09-29 00:12:46,226 INFO [ATS Logger 0]: hooks.ATSHook (ATSHook.java:createPreHookEvent(158)) - Received pre-hook notification for :hive_20160929001246_f884029f-a16f-4ed6-a46a-5c9be5fe214e 2016-09-29 00:12:46,226 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.TezSessionPoolManager (TezSessionPoolManager.java:getNewSessionState(162)) - Created a new session for queue: null session id: c4463b79-a79f-4d09-9b01-541de897bd3c 2016-09-29 00:12:46,265 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Context (Context.java:getMRScratchDir(336)) - New scratch dir is hdfs://xxxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-12-46_125_3821666619784721761-297 2016-09-29 00:12:46,276 INFO [HiveServer2-Background-Pool: Thread-18397]: exec.Task (TezTask.java:updateSession(271)) - Tez session hasn't been created yet. Opening session 2016-09-29 00:12:46,276 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.TezSessionState (TezSessionState.java:open(130)) - Opening the session with id c4463b79-a79f-4d09-9b01-541de897bd3c for thread HiveServer2-Background-Pool: Thread-18397 log trace id - query id - hive_20160929001246_f884029f-a16f-4ed6-a46a-5c9be5fe214e 2016-09-29 00:12:46,276 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.TezSessionState (TezSessionState.java:open(146)) - User of session id c4463b79-a79f-4d09-9b01-541de897bd3c is anonymous 2016-09-29 00:12:46,293 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.DagUtils (DagUtils.java:localizeResource(957)) - Localizing resource because it does not exist: file:/usr/hdp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar to dest: hdfs://xxxxxx:8020/tmp/hive/anonymous/_tez_session_dir/c4463b79-a79f-4d09-9b01-541de897bd3c/hive-hcatalog-core.jar 2016-09-29 00:12:46,371 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.DagUtils (DagUtils.java:createLocalResource(723)) - Resource modification time: 1475088166364 2016-09-29 00:12:46,373 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.DagUtils (DagUtils.java:getHiveJarDirectory(881)) - Jar dir is null/directory doesn't exist. Choosing HIVE_INSTALL_DIR - /user/anonymous/.hiveJars 2016-09-29 00:12:46,591 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.DagUtils (DagUtils.java:createLocalResource(723)) - Resource modification time: 1474440861705 2016-09-29 00:12:46,613 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezClient.java:(191)) - Tez Client Version: [ component=tez-api, version=0.7.0.2.5.0.0-1245, revision=c98dc048175afd3f56a44f05a1c18c6813f0b9a4, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=2016-08-26T01:23:29Z ] 2016-09-29 00:12:46,613 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.TezSessionState (TezSessionState.java:open(192)) - Opening new Tez Session (id: c4463b79-a79f-4d09-9b01-541de897bd3c, scratch dir: hdfs://xxxxx:8020/tmp/hive/anonymous/_tez_session_dir/c4463b79-a79f-4d09-9b01-541de897bd3c) 2016-09-29 00:12:46,673 INFO [HiveServer2-Background-Pool: Thread-18397]: impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(299)) - Timeline service address: http://xxxx:8188/ws/v1/timeline/ 2016-09-29 00:12:46,674 INFO [HiveServer2-Background-Pool: Thread-18397]: client.RMProxy (RMProxy.java:newProxyInstance(125)) - Connecting to ResourceManager at xxxxx:8050 2016-09-29 00:12:46,674 INFO [HiveServer2-Background-Pool: Thread-18397]: client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at xxxxx:10200 2016-09-29 00:12:46,676 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezClient.java:start(364)) - Using org.apache.tez.dag.history.ats.acls.ATSV15HistoryACLPolicyManager to manage Timeline ACLs 2016-09-29 00:12:46,716 INFO [HiveServer2-Background-Pool: Thread-18397]: impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(299)) - Timeline service address: http://xxxxx:8188/ws/v1/timeline/ 2016-09-29 00:12:46,719 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezClient.java:start(405)) - Session mode. Starting session. 2016-09-29 00:12:46,719 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClientUtils (TezClientUtils.java:setupTezJarsLocalResources(173)) - Using tez.lib.uris value from configuration: /hdp/apps/2.5.0.0-1245/tez/tez.tar.gz 2016-09-29 00:12:46,749 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezCommonUtils.java:createTezSystemStagingPath(122)) - Tez system stage directory hdfs://xxxxxx:8020/tmp/hive/anonymous/_tez_session_dir/c4463b79-a79f-4d09-9b01-541de897bd3c/.tez/application_1474698354744_0066 doesn't exist and is created 2016-09-29 00:12:46,828 INFO [HiveServer2-Background-Pool: Thread-18397]: acls.ATSV15HistoryACLPolicyManager (ATSV15HistoryACLPolicyManager.java:createSessionDomain(171)) - Created Timeline Domain for History ACLs, domainId=Tez_ATS_application_1474698354744_0066 2016-09-29 00:12:47,005 INFO [HiveServer2-Background-Pool: Thread-18397]: impl.YarnClientImpl (YarnClientImpl.java:submitApplication(279)) - Submitted application application_1474698354744_0066 2016-09-29 00:12:47,005 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezClient.java:start(439)) - The url to track the Tez Session: http://xxxxx:8088/proxy/application_1474698354744_0066/ 2016-09-29 00:12:47,005 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.TezSessionState (TezSessionState.java:open(200)) - Prewarming 2 containers (id: c4463b79-a79f-4d09-9b01-541de897bd3c, scratch dir: hdfs://xxxx:8020/tmp/hive/anonymous/_tez_session_dir/c4463b79-a79f-4d09-9b01-541de897bd3c) 2016-09-29 00:12:56,605 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezClient.java:submitDAGSession(484)) - Submitting dag to TezSession, sessionName=HIVE-c4463b79-a79f-4d09-9b01-541de897bd3c, applicationId=application_1474698354744_0066, dagName=TezPreWarmDAG_0 2016-09-29 00:12:56,746 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezClient.java:submitDAGSession(577)) - Submitted dag to TezSession, sessionName=HIVE-c4463b79-a79f-4d09-9b01-541de897bd3c, applicationId=application_1474698354744_0066, dagName=TezPreWarmDAG_0 2016-09-29 00:12:56,832 INFO [HiveServer2-Background-Pool: Thread-18397]: impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(299)) - Timeline service address: http://xxxx:8188/ws/v1/timeline/ 2016-09-29 00:12:56,832 INFO [HiveServer2-Background-Pool: Thread-18397]: client.RMProxy (RMProxy.java:newProxyInstance(125)) - Connecting to ResourceManager at xxxx/xxxx:8050 2016-09-29 00:12:56,833 INFO [HiveServer2-Background-Pool: Thread-18397]: client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at xxxx/xxxxx:10200 2016-09-29 00:13:01,178 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:01,178 INFO [HiveServer2-Background-Pool: Thread-18397]: exec.Task (TezTask.java:build(316)) - Dag name: SELECT * FROM soilsensor2 order by timed...5(Stage-1) 2016-09-29 00:13:01,178 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:01,210 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:01,211 INFO [HiveServer2-Background-Pool: Thread-18397]: exec.Utilities (Utilities.java:serializePlan(1030)) - Serializing ReduceWork via kryo 2016-09-29 00:13:01,212 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:01,212 INFO [HiveServer2-Background-Pool: Thread-18397]: exec.Utilities (Utilities.java:setBaseWork(716)) - Setting plan: /tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-12-46_125_3821666619784721761-297/anonymous/_tez_scratch_dir/e31dacc9-6414-450f-82e7-9caf6ab3deac/reduce.xml 2016-09-29 00:13:01,227 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:01,227 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:01,227 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Context (Context.java:getMRScratchDir(336)) - New scratch dir is hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-12-46_125_3821666619784721761-297 2016-09-29 00:13:01,244 INFO [HiveServer2-Background-Pool: Thread-18397]: tez.DagUtils (DagUtils.java:createVertex(555)) - Vertex has custom input? false 2016-09-29 00:13:01,245 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:01,245 INFO [HiveServer2-Background-Pool: Thread-18397]: exec.Utilities (Utilities.java:serializePlan(1030)) - Serializing MapWork via kryo 2016-09-29 00:13:01,245 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:01,245 INFO [HiveServer2-Background-Pool: Thread-18397]: exec.Utilities (Utilities.java:setBaseWork(716)) - Setting plan: /tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-12-46_125_3821666619784721761-297/anonymous/_tez_scratch_dir/86423774-9001-458c-9805-d678fef9d8a0/map.xml 2016-09-29 00:13:01,250 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:01,253 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:01,253 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:01,253 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezClient.java:submitDAGSession(484)) - Submitting dag to TezSession, sessionName=HIVE-c4463b79-a79f-4d09-9b01-541de897bd3c, applicationId=application_1474698354744_0066, dagName=SELECT * FROM soilsensor2 order by timed...5(Stage-1), callerContext={ context=HIVE, callerType=HIVE_QUERY_ID, callerId=hive_20160929001246_f884029f-a16f-4ed6-a46a-5c9be5fe214e } 2016-09-29 00:13:01,254 INFO [HiveServer2-Background-Pool: Thread-18397]: acls.ATSV15HistoryACLPolicyManager (ATSV15HistoryACLPolicyManager.java:createDAGDomain(211)) - Created Timeline Domain for DAG-specific History ACLs, domainId=Tez_ATS_application_1474698354744_0066_2 2016-09-29 00:13:01,463 INFO [HiveServer2-Background-Pool: Thread-18397]: client.TezClient (TezClient.java:submitDAGSession(577)) - Submitted dag to TezSession, sessionName=HIVE-c4463b79-a79f-4d09-9b01-541de897bd3c, applicationId=application_1474698354744_0066, dagName=SELECT * FROM soilsensor2 order by timed...5(Stage-1) 2016-09-29 00:13:01,570 INFO [HiveServer2-Background-Pool: Thread-18397]: impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(299)) - Timeline service address: http://xxxx:8188/ws/v1/timeline/ 2016-09-29 00:13:01,570 INFO [HiveServer2-Background-Pool: Thread-18397]: client.RMProxy (RMProxy.java:newProxyInstance(125)) - Connecting to ResourceManager at xxxx/xxxx:8050 2016-09-29 00:13:01,571 INFO [HiveServer2-Background-Pool: Thread-18397]: client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at xxxx/xxxx:10200 2016-09-29 00:13:01,573 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:01,573 INFO [HiveServer2-Background-Pool: Thread-18397]: SessionState (SessionState.java:printInfo(939)) - 2016-09-29 00:13:01,573 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:01,573 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:02,216 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:02,216 INFO [HiveServer2-Background-Pool: Thread-18397]: SessionState (SessionState.java:printInfo(939)) - Status: Running (Executing on YARN cluster with App id application_1474698354744_0066) 2016-09-29 00:13:02,216 INFO [HiveServer2-Background-Pool: Thread-18397]: SessionState (SessionState.java:printInfo(939)) - Map 1: -/- Reducer 2: 0/1 2016-09-29 00:13:02,421 INFO [HiveServer2-Background-Pool: Thread-18397]: SessionState (SessionState.java:printInfo(939)) - Map 1: 0/1 Reducer 2: 0/1 2016-09-29 00:13:03,444 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:03,444 INFO [HiveServer2-Background-Pool: Thread-18397]: SessionState (SessionState.java:printInfo(939)) - Map 1: 0(+1)/1 Reducer 2: 0/1 2016-09-29 00:13:04,274 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,275 INFO [HiveServer2-Background-Pool: Thread-18397]: SessionState (SessionState.java:printInfo(939)) - Map 1: 1/1 Reducer 2: 0/1 2016-09-29 00:13:04,476 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:04,476 INFO [HiveServer2-Background-Pool: Thread-18397]: SessionState (SessionState.java:printInfo(939)) - Map 1: 1/1 Reducer 2: 0(+1)/1 2016-09-29 00:13:04,900 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,900 INFO [HiveServer2-Background-Pool: Thread-18397]: SessionState (SessionState.java:printInfo(939)) - Map 1: 1/1 Reducer 2: 1/1 2016-09-29 00:13:04,900 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,911 INFO [HiveServer2-Background-Pool: Thread-18397]: exec.FileSinkOperator (Utilities.java:mvFileToFinalPath(2015)) - Moving tmp dir: hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-12-46_125_3821666619784721761-296/-mr-10000/.hive-staging_hive_2016-09-29_00-12-46_125_3821666619784721761-296/_tmp.-ext-10001 to: hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-12-46_125_3821666619784721761-296/-mr-10000/.hive-staging_hive_2016-09-29_00-12-46_125_3821666619784721761-296/-ext-10001 2016-09-29 00:13:04,946 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,946 INFO [HiveServer2-Background-Pool: Thread-18397]: hooks.ATSHook (ATSHook.java:(90)) - Created ATS Hook 2016-09-29 00:13:04,946 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:04,946 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,947 INFO [ATS Logger 0]: hooks.ATSHook (ATSHook.java:createPostHookEvent(193)) - Received post-hook notification for :hive_20160929001246_f884029f-a16f-4ed6-a46a-5c9be5fe214e 2016-09-29 00:13:04,947 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (Driver.java:execute(1635)) - Resetting the caller context to HIVE_SSN_ID:fec76346-1ea4-4f37-85b1-4fcf442be39d 2016-09-29 00:13:04,947 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,947 INFO [HiveServer2-Background-Pool: Thread-18397]: ql.Driver (SessionState.java:printInfo(939)) - OK 2016-09-29 00:13:04,947 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:04,947 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,947 INFO [HiveServer2-Background-Pool: Thread-18397]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,948 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:04,948 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:04,948 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:04,948 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Driver (Driver.java:compile(426)) - We are setting the hadoop caller context from HIVE_SSN_ID:fec76346-1ea4-4f37-85b1-4fcf442be39d to hive_20160929001304_8e412d6f-3778-41b0-bf5a-88cd13b432d7 2016-09-29 00:13:04,949 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:04,949 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: SELECT * FROM soilsensor2 order by timedate LIMIT 5 2016-09-29 00:13:04,949 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2016-09-29 00:13:04,949 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:04,949 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:04,949 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10390)) - Starting Semantic Analysis 2016-09-29 00:13:04,949 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10337)) - Completed phase 1 of Semantic Analysis 2016-09-29 00:13:04,949 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1587)) - Get metadata for source tables 2016-09-29 00:13:04,950 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 2175: get_table : db=default tbl=soilsensor2 2016-09-29 00:13:04,950 INFO [HiveServer2-Handler-Pool: Thread-18366]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=anonymous ip=unknown-ip-addr cmd=get_table : db=default tbl=soilsensor2 2016-09-29 00:13:04,958 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1743)) - Get metadata for subqueries 2016-09-29 00:13:04,959 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1767)) - Get metadata for destination tables 2016-09-29 00:13:04,972 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Context (Context.java:getMRScratchDir(336)) - New scratch dir is hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-13-04_948_2783128271134152744-296 2016-09-29 00:13:04,972 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10341)) - Completed getting MetaData in Semantic Analysis 2016-09-29 00:13:04,973 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.BaseSemanticAnalyzer (CalcitePlanner.java:canCBOHandleAst(397)) - Not invoking CBO because the statement has too few joins 2016-09-29 00:13:04,973 INFO [HiveServer2-Handler-Pool: Thread-18366]: common.FileUtils (FileUtils.java:mkdir(519)) - Creating directory if it doesn't exist: hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-13-04_948_2783128271134152744-296/-mr-10000/.hive-staging_hive_2016-09-29_00-13-04_948_2783128271134152744-296 2016-09-29 00:13:05,028 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(694)) - Processing for FS(2940) 2016-09-29 00:13:05,029 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(694)) - Processing for SEL(2938) 2016-09-29 00:13:05,029 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(694)) - Processing for RS(2937) 2016-09-29 00:13:05,029 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(694)) - Processing for SEL(2936) 2016-09-29 00:13:05,029 INFO [HiveServer2-Handler-Pool: Thread-18366]: ppd.OpProcFactory (OpProcFactory.java:process(413)) - Processing for TS(2935) 2016-09-29 00:13:05,029 INFO [HiveServer2-Handler-Pool: Thread-18366]: optimizer.ColumnPrunerProcFactory (ColumnPrunerProcFactory.java:pruneReduceSinkOperator(866)) - RS 2937 oldColExprMap: {VALUE._col2=Column[_col2], VALUE._col3=Column[_col3], VALUE._col0=Column[_col0], VALUE._col1=Column[_col1], KEY.reducesinkkey0=Column[_col4]} 2016-09-29 00:13:05,029 INFO [HiveServer2-Handler-Pool: Thread-18366]: optimizer.ColumnPrunerProcFactory (ColumnPrunerProcFactory.java:pruneReduceSinkOperator(915)) - RS 2937 newColExprMap: {VALUE._col2=Column[_col2], VALUE._col3=Column[_col3], VALUE._col0=Column[_col0], VALUE._col1=Column[_col1], KEY.reducesinkkey0=Column[_col4]} 2016-09-29 00:13:05,030 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,030 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,030 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822)) - 2175: get_table_statistics_req: db=default table=soilsensor2 2016-09-29 00:13:05,030 INFO [HiveServer2-Handler-Pool: Thread-18366]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391)) - ugi=anonymous ip=unknown-ip-addr cmd=get_table_statistics_req: db=default table=soilsensor2 2016-09-29 00:13:05,038 INFO [HiveServer2-Handler-Pool: Thread-18366]: optimizer.SetReducerParallelism (SetReducerParallelism.java:process(108)) - Number of reducers determined to be: 1 2016-09-29 00:13:05,038 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(157)) - Cycle free: true 2016-09-29 00:13:05,039 INFO [HiveServer2-Handler-Pool: Thread-18366]: physical.Vectorizer (Vectorizer.java:validateMapWork(648)) - Validating MapWork... 2016-09-29 00:13:05,039 INFO [HiveServer2-Handler-Pool: Thread-18366]: physical.Vectorizer (Vectorizer.java:verifyAndSetVectorPartDesc(498)) - The input format org.apache.hadoop.mapred.TextInputFormat of path hdfs://xxxx:8020/apps/hive/warehouse/soilsensor2 doesn't provide vectorized input 2016-09-29 00:13:05,039 INFO [HiveServer2-Handler-Pool: Thread-18366]: parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10495)) - Completed plan generation 2016-09-29 00:13:05,039 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Driver (Driver.java:compile(476)) - Semantic Analysis Completed 2016-09-29 00:13:05,039 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,040 INFO [HiveServer2-Handler-Pool: Thread-18366]: exec.ListSinkOperator (Operator.java:initialize(333)) - Initializing operator OP[2941] 2016-09-29 00:13:05,040 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Driver (Driver.java:getSchema(252)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:soilsensor2.macaddress, type:string, comment:null), FieldSchema(name:soilsensor2.sensorid, type:string, comment:null), FieldSchema(name:soilsensor2.sensorname, type:string, comment:null), FieldSchema(name:soilsensor2.sensorvalue, type:double, comment:null), FieldSchema(name:soilsensor2.timedate, type:string, comment:null)], properties:null) 2016-09-29 00:13:05,040 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,040 INFO [HiveServer2-Handler-Pool: Thread-18366]: ql.Driver (Driver.java:compile(558)) - We are resetting the hadoop caller context to HIVE_SSN_ID:fec76346-1ea4-4f37-85b1-4fcf442be39d 2016-09-29 00:13:05,040 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:05,041 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (Driver.java:checkConcurrency(172)) - Concurrency mode is disabled, not creating a lock manager 2016-09-29 00:13:05,041 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,041 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (Driver.java:execute(1406)) - Setting caller context to query id hive_20160929001304_8e412d6f-3778-41b0-bf5a-88cd13b432d7 2016-09-29 00:13:05,041 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (Driver.java:execute(1409)) - Starting command(queryId=hive_20160929001304_8e412d6f-3778-41b0-bf5a-88cd13b432d7): SELECT * FROM soilsensor2 order by timedate LIMIT 5 2016-09-29 00:13:05,041 INFO [HiveServer2-Background-Pool: Thread-18431]: hooks.ATSHook (ATSHook.java:(90)) - Created ATS Hook 2016-09-29 00:13:05,041 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,042 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,042 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (SessionState.java:printInfo(939)) - Query ID = hive_20160929001304_8e412d6f-3778-41b0-bf5a-88cd13b432d7 2016-09-29 00:13:05,042 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (SessionState.java:printInfo(939)) - Total jobs = 1 2016-09-29 00:13:05,042 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,042 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (SessionState.java:printInfo(939)) - Launching Job 1 out of 1 2016-09-29 00:13:05,042 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (Driver.java:launchTask(1743)) - Starting task [Stage-1:MAPRED] in serial mode 2016-09-29 00:13:05,042 INFO [HiveServer2-Background-Pool: Thread-18431]: tez.TezSessionPoolManager (TezSessionPoolManager.java:canWorkWithSameSession(245)) - The current user: anonymous, session user: anonymous 2016-09-29 00:13:05,042 INFO [HiveServer2-Background-Pool: Thread-18431]: tez.TezSessionPoolManager (TezSessionPoolManager.java:canWorkWithSameSession(262)) - Current queue name is null incoming queue name is null 2016-09-29 00:13:05,042 INFO [ATS Logger 0]: hooks.ATSHook (ATSHook.java:createPreHookEvent(158)) - Received pre-hook notification for :hive_20160929001304_8e412d6f-3778-41b0-bf5a-88cd13b432d7 2016-09-29 00:13:05,080 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Context (Context.java:getMRScratchDir(336)) - New scratch dir is hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-13-04_948_2783128271134152744-298 2016-09-29 00:13:05,093 INFO [HiveServer2-Background-Pool: Thread-18431]: exec.Task (TezTask.java:updateSession(274)) - Session is already open 2016-09-29 00:13:05,095 INFO [HiveServer2-Background-Pool: Thread-18431]: tez.DagUtils (DagUtils.java:createLocalResource(723)) - Resource modification time: 1475088166364 2016-09-29 00:13:05,095 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,095 INFO [HiveServer2-Background-Pool: Thread-18431]: exec.Task (TezTask.java:build(316)) - Dag name: SELECT * FROM soilsensor2 order by timed...5(Stage-1) 2016-09-29 00:13:05,095 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,105 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,105 INFO [HiveServer2-Background-Pool: Thread-18431]: exec.Utilities (Utilities.java:serializePlan(1030)) - Serializing ReduceWork via kryo 2016-09-29 00:13:05,107 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,107 INFO [HiveServer2-Background-Pool: Thread-18431]: exec.Utilities (Utilities.java:setBaseWork(716)) - Setting plan: /tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-13-04_948_2783128271134152744-298/anonymous/_tez_scratch_dir/808e2e49-b49d-4e6c-84e1-3cde861cbc9f/reduce.xml 2016-09-29 00:13:05,123 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,123 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,124 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Context (Context.java:getMRScratchDir(336)) - New scratch dir is hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-13-04_948_2783128271134152744-298 2016-09-29 00:13:05,139 INFO [HiveServer2-Background-Pool: Thread-18431]: tez.DagUtils (DagUtils.java:createVertex(555)) - Vertex has custom input? false 2016-09-29 00:13:05,139 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,139 INFO [HiveServer2-Background-Pool: Thread-18431]: exec.Utilities (Utilities.java:serializePlan(1030)) - Serializing MapWork via kryo 2016-09-29 00:13:05,140 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,140 INFO [HiveServer2-Background-Pool: Thread-18431]: exec.Utilities (Utilities.java:setBaseWork(716)) - Setting plan: /tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-13-04_948_2783128271134152744-298/anonymous/_tez_scratch_dir/153779e7-c999-4f0c-a310-c55bd12626ef/map.xml 2016-09-29 00:13:05,145 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,147 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,147 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,147 INFO [HiveServer2-Background-Pool: Thread-18431]: client.TezClient (TezClient.java:submitDAGSession(484)) - Submitting dag to TezSession, sessionName=HIVE-c4463b79-a79f-4d09-9b01-541de897bd3c, applicationId=application_1474698354744_0066, dagName=SELECT * FROM soilsensor2 order by timed...5(Stage-1), callerContext={ context=HIVE, callerType=HIVE_QUERY_ID, callerId=hive_20160929001304_8e412d6f-3778-41b0-bf5a-88cd13b432d7 } 2016-09-29 00:13:05,148 INFO [HiveServer2-Background-Pool: Thread-18431]: acls.ATSV15HistoryACLPolicyManager (ATSV15HistoryACLPolicyManager.java:createDAGDomain(211)) - Created Timeline Domain for DAG-specific History ACLs, domainId=Tez_ATS_application_1474698354744_0066_3 2016-09-29 00:13:05,251 INFO [HiveServer2-Background-Pool: Thread-18431]: client.TezClient (TezClient.java:submitDAGSession(577)) - Submitted dag to TezSession, sessionName=HIVE-c4463b79-a79f-4d09-9b01-541de897bd3c, applicationId=application_1474698354744_0066, dagName=SELECT * FROM soilsensor2 order by timed...5(Stage-1) 2016-09-29 00:13:05,337 INFO [HiveServer2-Background-Pool: Thread-18431]: impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(299)) - Timeline service address: http://xxxx:8188/ws/v1/timeline/ 2016-09-29 00:13:05,337 INFO [HiveServer2-Background-Pool: Thread-18431]: client.RMProxy (RMProxy.java:newProxyInstance(125)) - Connecting to ResourceManager at xxxx/xxxx:8050 2016-09-29 00:13:05,337 INFO [HiveServer2-Background-Pool: Thread-18431]: client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to Application History server at xxxx/xxxx:10200 2016-09-29 00:13:05,339 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,340 INFO [HiveServer2-Background-Pool: Thread-18431]: SessionState (SessionState.java:printInfo(939)) - 2016-09-29 00:13:05,340 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,340 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:05,350 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:05,350 INFO [HiveServer2-Background-Pool: Thread-18431]: SessionState (SessionState.java:printInfo(939)) - Status: Running (Executing on YARN cluster with App id application_1474698354744_0066) 2016-09-29 00:13:05,351 INFO [HiveServer2-Background-Pool: Thread-18431]: SessionState (SessionState.java:printInfo(939)) - Map 1: 0/1 Reducer 2: 0/1 2016-09-29 00:13:06,164 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:06,165 INFO [HiveServer2-Background-Pool: Thread-18431]: SessionState (SessionState.java:printInfo(939)) - Map 1: 0(+1)/1 Reducer 2: 0/1 2016-09-29 00:13:06,367 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:06,367 INFO [HiveServer2-Background-Pool: Thread-18431]: SessionState (SessionState.java:printInfo(939)) - Map 1: 1/1 Reducer 2: 0/1 2016-09-29 00:13:06,587 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:06,587 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:06,587 INFO [HiveServer2-Background-Pool: Thread-18431]: SessionState (SessionState.java:printInfo(939)) - Map 1: 1/1 Reducer 2: 1/1 2016-09-29 00:13:06,789 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:06,796 INFO [HiveServer2-Background-Pool: Thread-18431]: exec.FileSinkOperator (Utilities.java:mvFileToFinalPath(2015)) - Moving tmp dir: hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-13-04_948_2783128271134152744-296/-mr-10000/.hive-staging_hive_2016-09-29_00-13-04_948_2783128271134152744-296/_tmp.-ext-10001 to: hdfs://xxxx:8020/tmp/hive/anonymous/fec76346-1ea4-4f37-85b1-4fcf442be39d/hive_2016-09-29_00-13-04_948_2783128271134152744-296/-mr-10000/.hive-staging_hive_2016-09-29_00-13-04_948_2783128271134152744-296/-ext-10001 2016-09-29 00:13:06,824 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:06,824 INFO [HiveServer2-Background-Pool: Thread-18431]: hooks.ATSHook (ATSHook.java:(90)) - Created ATS Hook 2016-09-29 00:13:06,824 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:06,825 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:06,825 INFO [ATS Logger 0]: hooks.ATSHook (ATSHook.java:createPostHookEvent(193)) - Received post-hook notification for :hive_20160929001304_8e412d6f-3778-41b0-bf5a-88cd13b432d7 2016-09-29 00:13:06,825 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (Driver.java:execute(1635)) - Resetting the caller context to HIVE_SSN_ID:fec76346-1ea4-4f37-85b1-4fcf442be39d 2016-09-29 00:13:06,825 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:06,825 INFO [HiveServer2-Background-Pool: Thread-18431]: ql.Driver (SessionState.java:printInfo(939)) - OK 2016-09-29 00:13:06,826 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:06,826 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:06,826 INFO [HiveServer2-Background-Pool: Thread-18431]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:06,907 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:06,907 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:06,980 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:06,980 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,021 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,025 INFO [HiveServer2-Handler-Pool: Thread-18366]: mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2016-09-29 00:13:07,069 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,141 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,141 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,180 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,219 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:07,220 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:07,220 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,311 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:deleteContext(137)) - Session disconnected without closing properly, close it now 2016-09-29 00:13:07,311 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,311 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,311 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to fec76346-1ea4-4f37-85b1-4fcf442be39d for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:07,350 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - 2016-09-29 00:13:07,350 INFO [HiveServer2-Handler-Pool: Thread-18366]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - 2016-09-29 00:13:07,351 INFO [HiveServer2-Handler-Pool: Thread-18366]: tez.TezSessionPoolManager (TezSessionPoolManager.java:close(183)) - Closing tez session default? false 2016-09-29 00:13:07,351 INFO [HiveServer2-Handler-Pool: Thread-18366]: tez.TezSessionState (TezSessionState.java:close(268)) - Closing Tez Session 2016-09-29 00:13:07,371 INFO [HiveServer2-Handler-Pool: Thread-18366]: client.TezClient (TezClient.java:stop(598)) - Shutting down Tez Session, sessionName=HIVE-c4463b79-a79f-4d09-9b01-541de897bd3c, applicationId=application_1474698354744_0066 2016-09-29 00:13:07,413 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:38,118 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-09-29 00:13:38,119 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:13:38,133 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:13:38,134 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:13:38,134 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:13:38,137 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:13:38,137 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:13:38,137 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:13:38,138 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:13:38,206 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/9aae10b1-fe33-43f4-a314-7c2e41e34ced_resources 2016-09-29 00:13:38,295 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/9aae10b1-fe33-43f4-a314-7c2e41e34ced 2016-09-29 00:13:38,298 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/9aae10b1-fe33-43f4-a314-7c2e41e34ced 2016-09-29 00:13:38,336 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/9aae10b1-fe33-43f4-a314-7c2e41e34ced/_tmp_space.db 2016-09-29 00:13:38,351 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/9aae10b1-fe33-43f4-a314-7c2e41e34ced 2016-09-29 00:13:38,460 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 9aae10b1-fe33-43f4-a314-7c2e41e34ced for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:38,460 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:38,467 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 9aae10b1-fe33-43f4-a314-7c2e41e34ced for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:38,467 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:38,507 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 9aae10b1-fe33-43f4-a314-7c2e41e34ced for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:38,507 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:38,507 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 9aae10b1-fe33-43f4-a314-7c2e41e34ced for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:13:38,525 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:33,323 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V7 2016-09-29 00:16:33,324 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:16:33,327 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:16:33,327 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:16:33,328 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:16:33,329 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:16:33,330 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:16:33,330 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:16:33,330 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:16:33,334 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/4f9495c1-e0c0-413e-b5f6-d534bc40b8b4_resources 2016-09-29 00:16:33,363 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/4f9495c1-e0c0-413e-b5f6-d534bc40b8b4 2016-09-29 00:16:33,365 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/4f9495c1-e0c0-413e-b5f6-d534bc40b8b4 2016-09-29 00:16:33,377 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/4f9495c1-e0c0-413e-b5f6-d534bc40b8b4/_tmp_space.db 2016-09-29 00:16:33,378 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/4f9495c1-e0c0-413e-b5f6-d534bc40b8b4 2016-09-29 00:16:33,457 ERROR [HiveServer2-Handler-Pool: Thread-18366]: server.TThreadPoolServer (TThreadPoolServer.java:run(295)) - Thrift error occurred during processing of message. org.apache.thrift.protocol.TProtocolException: Missing version in readMessageBegin, old client? at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:228) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2016-09-29 00:16:33,458 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:deleteContext(137)) - Session disconnected without closing properly, close it now 2016-09-29 00:16:33,458 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 4f9495c1-e0c0-413e-b5f6-d534bc40b8b4 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:33,458 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:33,458 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to 4f9495c1-e0c0-413e-b5f6-d534bc40b8b4 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:33,474 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:37,728 INFO [HiveServer2-Handler-Pool: Thread-18366]: thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(313)) - Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8 2016-09-29 00:16:37,729 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:initialize(299)) - ObjectStore, initialize called 2016-09-29 00:16:37,733 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:(139)) - Using direct SQL, underlying DB is MYSQL 2016-09-29 00:16:37,733 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.ObjectStore (ObjectStore.java:setConf(282)) - Initialized ObjectStore 2016-09-29 00:16:37,734 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(523)) - Begin calculating metadata count metrics. 2016-09-29 00:16:37,737 INFO [HiveServer2-Handler-Pool: Thread-18366]: metastore.HiveMetaStore (HiveMetaStore.java:init(525)) - Finished metadata count metrics: 1 databases, 9 tables, 0 partitions. 2016-09-29 00:16:37,737 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:16:37,737 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:16:37,737 WARN [HiveServer2-Handler-Pool: Thread-18366]: metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended 2016-09-29 00:16:37,742 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/a6a8db8b-b741-4e9d-95cc-c7dec3152267_resources 2016-09-29 00:16:37,780 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/a6a8db8b-b741-4e9d-95cc-c7dec3152267 2016-09-29 00:16:37,794 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created local directory: /tmp/hive/a6a8db8b-b741-4e9d-95cc-c7dec3152267 2016-09-29 00:16:37,809 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.SessionState (SessionState.java:createPath(642)) - Created HDFS directory: /tmp/hive/anonymous/a6a8db8b-b741-4e9d-95cc-c7dec3152267/_tmp_space.db 2016-09-29 00:16:37,816 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(264)) - Operation log session directory is created: /tmp/hive/operation_logs/a6a8db8b-b741-4e9d-95cc-c7dec3152267 2016-09-29 00:16:37,954 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to a6a8db8b-b741-4e9d-95cc-c7dec3152267 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:37,954 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:37,961 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to a6a8db8b-b741-4e9d-95cc-c7dec3152267 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:37,961 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:37,992 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to a6a8db8b-b741-4e9d-95cc-c7dec3152267 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:37,992 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:37,992 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context to a6a8db8b-b741-4e9d-95cc-c7dec3152267 for thread HiveServer2-Handler-Pool: Thread-18366 2016-09-29 00:16:38,018 INFO [HiveServer2-Handler-Pool: Thread-18366]: session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-18366