Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.1.2
-
None
-
None
-
OS: CentOS 7 based on VMWare 16
MEM:4G
DISK:40G
CPU: hostcpu: interl i5-10gen
HADOOP 3.1.3, one namenode, two datanode
HIVE 3.1.2 with metadata changed to mysql
Description
Dear profeesors,
As described, after installing hadoop 3.1.3 and hive 3.1.2, I easily insert one row into a simple table with SQL
Hive> insert into test2 values ('aaa') ;
I got FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask
Then I check into the detailed log, found it seems something wrong with the hive stats task on coding level, part of the detailed logs as follows for your reference
would you please kindly take a look and advise ?
thanks in advance and kind regards
Lei
"
2021-05-06T14:30:32,609 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient trying reconnect as root (auth:SIMPLE)
2021-05-06T14:30:32,609 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Closed a connection to metastore, current connections: 1
2021-05-06T14:30:32,610 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Trying to connect to metastore with URI thrift://master:9083
2021-05-06T14:30:32,610 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Opened a connection to metastore, current connections: 2
2021-05-06T14:30:32,611 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Connected to metastore.
2021-05-06T14:30:32,657 ERROR [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] exec.StatsTask: Failed to run stats task
org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.transport.TTransportException
at org.apache.hadoop.hive.ql.metadata.Hive.setPartitionColumnStatistics(Hive.java:4423) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.stats.ColStatsProcessor.persistColumnStats(ColStatsProcessor.java:179) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.stats.ColStatsProcessor.process(ColStatsProcessor.java:83) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.exec.StatsTask.execute(StatsTask.java:108) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) ~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) ~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) ~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) ~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) ~[hive-cli-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) ~[hive-cli-3.1.2.jar:3.1.2]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
at org.apache.hadoop.util.RunJar.run(RunJar.java:318) ~[hadoop-common-3.1.3.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:232) ~[hadoop-common-3.1.3.jar:?]
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_set_aggr_stats_for(ThriftHiveMetastore.java:4104) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.set_aggr_stats_for(ThriftHiveMetastore.java:4091) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setPartitionColumnStatistics(HiveMetaStoreClient.java:1927) ~[hive-exec-3.1.2.jar:3.1.2]
at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.setPartitionColumnStatistics(SessionHiveMetaStoreClient.java:409) ~[hive-exec-3.1.2.jar:3.1.2]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) ~[hive-exec-3.1.2.jar:3.1.2]
at com.sun.proxy.$Proxy34.setPartitionColumnStatistics(Unknown Source) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2773) ~[hive-exec-3.1.2.jar:3.1.2]
at com.sun.proxy.$Proxy34.setPartitionColumnStatistics(Unknown Source) ~[?:?]
at org.apache.hadoop.hive.ql.metadata.Hive.setPartitionColumnStatistics(Hive.java:4420) ~[hive-exec-3.1.2.jar:3.1.2]
... 24 more
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] reexec.ReOptimizePlugin: ReOptimization: retryPossible: false
2021-05-06T14:30:32,657 ERROR [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: MapReduce Jobs Launched:
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Stage-Stage-1: Map: 1 Reduce: 1 Cumulative CPU: 3.66 sec HDFS Read: 13193 HDFS Write: 203 SUCCESS
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Total MapReduce CPU Time Spent: 3 seconds 660 msec
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Completed executing command(queryId=root_20210506143001_39fbd0ce-3360-40ba-948b-015f2ec166c5); Time taken: 28.603 seconds
2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-05-06T14:30:32,702 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] conf.HiveConf: Using the default value passed in for log id: 38c1f98d-9d5a-4bb6-b052-e63eda036c08
2021-05-06T14:30:32,702 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] session.SessionState: Resetting thread name to main
"