Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25094

when easily insert row with hive, got ERROR exec.StatsTask: Failed to run stats task

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.2
    • Fix Version/s: None
    • Component/s: Hive
    • Labels:
      None
    • Environment:

      OS: CentOS 7 based on VMWare 16

      MEM:4G

      DISK:40G

      CPU: hostcpu: interl i5-10gen

      HADOOP 3.1.3, one namenode, two datanode

      HIVE 3.1.2 with metadata changed to mysql

      Description

      Dear profeesors,

      As described, after installing hadoop 3.1.3 and hive 3.1.2, I easily insert one row into a simple table with SQL

      Hive> insert into test2 values ('aaa') ;

      I got FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask

      Then I check into the detailed log, found it seems something wrong with the hive stats task on coding level, part of the detailed logs as follows for your reference

      would you please kindly take a look and advise ?

      thanks in advance and kind regards

      Lei

      "

      2021-05-06T14:30:32,609 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient trying reconnect as root (auth:SIMPLE)
      2021-05-06T14:30:32,609 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Closed a connection to metastore, current connections: 1
      2021-05-06T14:30:32,610 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Trying to connect to metastore with URI thrift://master:9083
      2021-05-06T14:30:32,610 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Opened a connection to metastore, current connections: 2
      2021-05-06T14:30:32,611 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Connected to metastore.
      2021-05-06T14:30:32,657 ERROR [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] exec.StatsTask: Failed to run stats task
      org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.transport.TTransportException
      at org.apache.hadoop.hive.ql.metadata.Hive.setPartitionColumnStatistics(Hive.java:4423) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.stats.ColStatsProcessor.persistColumnStats(ColStatsProcessor.java:179) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.stats.ColStatsProcessor.process(ColStatsProcessor.java:83) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.exec.StatsTask.execute(StatsTask.java:108) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) ~[hive-cli-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) ~[hive-cli-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) ~[hive-cli-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) ~[hive-cli-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) ~[hive-cli-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) ~[hive-cli-3.1.2.jar:3.1.2]
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
      at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
      at org.apache.hadoop.util.RunJar.run(RunJar.java:318) ~[hadoop-common-3.1.3.jar:?]
      at org.apache.hadoop.util.RunJar.main(RunJar.java:232) ~[hadoop-common-3.1.3.jar:?]
      Caused by: org.apache.thrift.transport.TTransportException
      at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_set_aggr_stats_for(ThriftHiveMetastore.java:4104) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.set_aggr_stats_for(ThriftHiveMetastore.java:4091) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setPartitionColumnStatistics(HiveMetaStoreClient.java:1927) ~[hive-exec-3.1.2.jar:3.1.2]
      at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.setPartitionColumnStatistics(SessionHiveMetaStoreClient.java:409) ~[hive-exec-3.1.2.jar:3.1.2]
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
      at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
      at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) ~[hive-exec-3.1.2.jar:3.1.2]
      at com.sun.proxy.$Proxy34.setPartitionColumnStatistics(Unknown Source) ~[?:?]
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
      at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2773) ~[hive-exec-3.1.2.jar:3.1.2]
      at com.sun.proxy.$Proxy34.setPartitionColumnStatistics(Unknown Source) ~[?:?]
      at org.apache.hadoop.hive.ql.metadata.Hive.setPartitionColumnStatistics(Hive.java:4420) ~[hive-exec-3.1.2.jar:3.1.2]
      ... 24 more
      2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] reexec.ReOptimizePlugin: ReOptimization: retryPossible: false
      2021-05-06T14:30:32,657 ERROR [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask
      2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: MapReduce Jobs Launched:
      2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Stage-Stage-1: Map: 1 Reduce: 1 Cumulative CPU: 3.66 sec HDFS Read: 13193 HDFS Write: 203 SUCCESS
      2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Total MapReduce CPU Time Spent: 3 seconds 660 msec
      2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Completed executing command(queryId=root_20210506143001_39fbd0ce-3360-40ba-948b-015f2ec166c5); Time taken: 28.603 seconds
      2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
      2021-05-06T14:30:32,702 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] conf.HiveConf: Using the default value passed in for log id: 38c1f98d-9d5a-4bb6-b052-e63eda036c08
      2021-05-06T14:30:32,702 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] session.SessionState: Resetting thread name to main

      "

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Melodie Lei Su
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: