Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4718

array out of bounds exception near VectorHashKeyWrapper.getBytes() with 2 column GROUP BY

    XMLWordPrintableJSON

    Details

      Description

      select ddate, disinternalmsft16431, count(*) from factsqlengineam_vec_orc
      where (ddate = '2012-05-19 00:00:00' or ddate = '2012-05-20 00:00:00') and (disinternalmsft16431 = 0 or disinternalmsft16431 = 5)
      group by ddate, disinternalmsft16431;


      Diagnostic Messages for this Task:
      java.lang.RuntimeException: Hive Runtime Error while closing operators
      at org.apache.hadoop.hive.ql.exec.vector.VectorExecMapper.close(VectorExecMapper.java:229)
      at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
      at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
      at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
      at org.apache.hadoop.mapred.Child.main(Child.java:265)
      Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
      at org.apache.hadoop.hive.ql.exec.vector.VectorHashKeyWrapper.getBytes(VectorHashKeyWrapper.java:226)
      at org.apache.hadoop.hive.ql.exec.vector.VectorHashKeyWrapperBatch.getWritableKeyValue(VectorHashKeyWrapperBatch.java:528)
      at org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flush(VectorGroupByOperator.java:293)
      at org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.closeOp(VectorGroupByOperator.java:423)
      at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:588)
      at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      at org.apache.hadoop.hive.ql.exec.vector.VectorExecMapper.close(VectorExecMapper.java:196)
      ... 8 more

      FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask

        Attachments

        1. HIVE-4718.3.patch.txt
          23 kB
          Remus Rusanu
        2. HIVE-4718.2.patch.txt
          23 kB
          Remus Rusanu

          Issue Links

            Activity

              People

              • Assignee:
                rusanu Remus Rusanu
                Reporter:
                ehans Eric N. Hanson
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: