Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13394

Analyze table fails in tez on empty partitions/files/tables

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.2.1, 2.0.0
    • 1.2.2, 2.0.1, 2.1.0
    • Tez
    • None

    Description

              at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource$GroupIterator.next(ReduceRecordSource.java:352)
              at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:237)
              at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:252)
              at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:150)
              ... 14 more
      Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ArrayIndexOutOfBoundsException: 0
              at org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:766)
              at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource$GroupIterator.next(ReduceRecordSource.java:343)
              ... 17 more
      Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
              at org.apache.hadoop.hive.ql.udf.generic.NumDistinctValueEstimator.deserialize(NumDistinctValueEstimator.java:219)
              at org.apache.hadoop.hive.ql.udf.generic.NumDistinctValueEstimator.<init>(NumDistinctValueEstimator.java:112)
              at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFComputeStats$GenericUDAFNumericStatsEvaluator.merge(GenericUDAFComputeStats.java:556)
              at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:188)
              at org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:612)
              at org.apache.hadoop.hive.ql.exec.GroupByOperator.processAggr(GroupByOperator.java:851)
              at org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:695)
              at org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:761)
              ... 18 more
      ]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1455918888034_27748_1_01 [Reducer 2] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
      

      Attachments

        1. HIVE-13394.1.patch
          1 kB
          Vikram Dixit K
        2. HIVE-13394.2.patch
          1 kB
          Vikram Dixit K

        Activity

          People

            vikram.dixit Vikram Dixit K
            vikram.dixit Vikram Dixit K
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: