Hive
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4774

Hive Runtime Error while closing operators: java.lang.NullPointerException

    Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: vectorization-branch
    • Fix Version/s: vectorization-branch, 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      table and data attached

      SELECT   cdouble,
               cint,
               (cdouble - -1),
               (-((cdouble - -1))),
               MIN((-((cdouble - -1)))),
               STDDEV_SAMP(cdouble),
               (0.00000000000000000000E+000 / (cdouble - -1))
      FROM     alltypes_orc
      WHERE    ((cdouble < cint)
                OR (cdouble <= cint))
      GROUP BY cdouble, cint
      ORDER BY cint;
      
      java.lang.RuntimeException: Hive Runtime Error while closing operators
      	at org.apache.hadoop.hive.ql.exec.vector.VectorExecMapper.close(VectorExecMapper.java:229)
      	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
      	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
      	at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:396)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
      	at org.apache.hadoop.mapred.Child.main(Child.java:265)
      Caused by: java.lang.NullPointerException
      	at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serialize(LazyBinarySerDe.java:292)
      	at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serializeStruct(LazyBinarySerDe.java:257)
      	at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serialize(LazyBinarySerDe.java:204)
      	at org.apache.hadoop.hive.ql.exec.ReduceSinkOperator.processOp(ReduceSinkOperator.java:245)
      	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flush(VectorGroupByOperator.java:302)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.closeOp(VectorGroupByOperator.java:423)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:588)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorExecMapper.close(VectorExecMapper.java:196)
      	... 8 more
      
      
      1. hive-4774.1.patch
        2 kB
        Remus Rusanu
      2. output.txt
        4 kB
        Tony Murphy
      3. tableAndData.zip
        244 kB
        Tony Murphy

        Activity

        Tony Murphy created issue -
        Tony Murphy made changes -
        Field Original Value New Value
        Attachment tableAndData.zip [ 12588961 ]
        Attachment output.txt [ 12588962 ]
        Remus Rusanu made changes -
        Assignee Remus Rusanu [ rusanu ]
        Remus Rusanu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Remus Rusanu made changes -
        Attachment hive-4774.1.patch [ 12589882 ]
        Ashutosh Chauhan made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Thejas M Nair made changes -
        Fix Version/s 0.13.0 [ 12324986 ]

          People

          • Assignee:
            Remus Rusanu
            Reporter:
            Tony Murphy
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development