Hive
  1. Hive
  2. HIVE-4837

Union on void type fails with NPE

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: Query Processor
    • Labels:
      None

      Description

      From mailing list, http://www.mail-archive.com/user@hive.apache.org/msg08683.html

      java.lang.RuntimeException: Error in configuring object
          at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
          at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
          at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
          at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432)
          at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
          at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
          at java.security.AccessController.doPrivileged(Native Method)
          at javax.security.auth.Subject.doAs(Subject.java:396)
          at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
          at org.apache.hadoop.mapred.Child.main(Child.java:249)
      Caused by: java.lang.reflect.InvocationTargetException
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
          ... 9 more
      Caused by: java.lang.RuntimeException: Error in configuring object
          at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
          at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
          at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
          at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
          ... 14 more
      Caused by: java.lang.reflect.InvocationTargetException
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
          ... 17 more
      Caused by: java.lang.RuntimeException: Map operator initialization failed
          at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
          ... 22 more
      Caused by: java.lang.NullPointerException
          at org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:64)
          at java.lang.String.valueOf(String.java:2826)
          at java.lang.StringBuilder.append(StringBuilder.java:115)
          at org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110)
          at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
          at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
          at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
          at org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:186)
          at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
          at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:563)
          at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
          at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:100)
          ... 22 more
      

        Activity

        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-hadoop2 #465 (See https://builds.apache.org/job/Hive-trunk-hadoop2/465/)
        HIVE-4837 : Union on void type fails with NPE (Navis via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527354)

        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java
        • /hive/trunk/ql/src/test/queries/clientpositive/union_null.q
        • /hive/trunk/ql/src/test/results/beelinepositive/union_null.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-hadoop2 #465 (See https://builds.apache.org/job/Hive-trunk-hadoop2/465/ ) HIVE-4837 : Union on void type fails with NPE (Navis via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527354 ) /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java /hive/trunk/ql/src/test/queries/clientpositive/union_null.q /hive/trunk/ql/src/test/results/beelinepositive/union_null.q.out /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-h0.21 #2367 (See https://builds.apache.org/job/Hive-trunk-h0.21/2367/)
        HIVE-4837 : Union on void type fails with NPE (Navis via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527354)

        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java
        • /hive/trunk/ql/src/test/queries/clientpositive/union_null.q
        • /hive/trunk/ql/src/test/results/beelinepositive/union_null.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-h0.21 #2367 (See https://builds.apache.org/job/Hive-trunk-h0.21/2367/ ) HIVE-4837 : Union on void type fails with NPE (Navis via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527354 ) /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java /hive/trunk/ql/src/test/queries/clientpositive/union_null.q /hive/trunk/ql/src/test/results/beelinepositive/union_null.q.out /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #186 (See https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/186/)
        HIVE-4837 : Union on void type fails with NPE (Navis via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527354)

        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java
        • /hive/trunk/ql/src/test/queries/clientpositive/union_null.q
        • /hive/trunk/ql/src/test/results/beelinepositive/union_null.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out
        Show
        Hudson added a comment - SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #186 (See https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/186/ ) HIVE-4837 : Union on void type fails with NPE (Navis via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527354 ) /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java /hive/trunk/ql/src/test/queries/clientpositive/union_null.q /hive/trunk/ql/src/test/results/beelinepositive/union_null.q.out /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-hadoop2-ptest #120 (See https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/120/)
        HIVE-4837 : Union on void type fails with NPE (Navis via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527354)

        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java
        • /hive/trunk/ql/src/test/queries/clientpositive/union_null.q
        • /hive/trunk/ql/src/test/results/beelinepositive/union_null.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-hadoop2-ptest #120 (See https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/120/ ) HIVE-4837 : Union on void type fails with NPE (Navis via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527354 ) /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java /hive/trunk/ql/src/test/queries/clientpositive/union_null.q /hive/trunk/ql/src/test/results/beelinepositive/union_null.q.out /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out
        Hide
        Ashutosh Chauhan added a comment -

        Committed to trunk. Thanks, Navis!

        Show
        Ashutosh Chauhan added a comment - Committed to trunk. Thanks, Navis!
        Hide
        Ashutosh Chauhan added a comment -

        +1

        Show
        Ashutosh Chauhan added a comment - +1
        Hide
        Phabricator added a comment -

        navis requested code review of "HIVE-4837 [jira] Union on void type fails with NPE".

        Reviewers: JIRA

        HIVE-4837 Union on void type fails with NPE

        From mailing list, http://www.mail-archive.com/user@hive.apache.org/msg08683.html

        java.lang.RuntimeException: Error in configuring object
        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
        Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
        ... 9 more
        Caused by: java.lang.RuntimeException: Error in configuring object
        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
        at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
        ... 14 more
        Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
        ... 17 more
        Caused by: java.lang.RuntimeException: Map operator initialization failed
        at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
        ... 22 more
        Caused by: java.lang.NullPointerException
        at org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:64)
        at java.lang.String.valueOf(String.java:2826)
        at java.lang.StringBuilder.append(StringBuilder.java:115)
        at org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
        at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
        at org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:186)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
        at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:563)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
        at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:100)
        ... 22 more

        TEST PLAN
        EMPTY

        REVISION DETAIL
        https://reviews.facebook.net/D11649

        AFFECTED FILES
        ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java
        ql/src/test/queries/clientpositive/union_null.q
        ql/src/test/results/beelinepositive/union_null.q.out
        ql/src/test/results/clientpositive/union_null.q.out

        MANAGE HERALD RULES
        https://reviews.facebook.net/herald/view/differential/

        WHY DID I GET THIS EMAIL?
        https://reviews.facebook.net/herald/transcript/27561/

        To: JIRA, navis

        Show
        Phabricator added a comment - navis requested code review of " HIVE-4837 [jira] Union on void type fails with NPE". Reviewers: JIRA HIVE-4837 Union on void type fails with NPE From mailing list, http://www.mail-archive.com/user@hive.apache.org/msg08683.html java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) ... 9 more Caused by: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34) ... 14 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) ... 17 more Caused by: java.lang.RuntimeException: Map operator initialization failed at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121) ... 22 more Caused by: java.lang.NullPointerException at org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:64) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451) at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407) at org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:186) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375) at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:563) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375) at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:100) ... 22 more TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D11649 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java ql/src/test/queries/clientpositive/union_null.q ql/src/test/results/beelinepositive/union_null.q.out ql/src/test/results/clientpositive/union_null.q.out MANAGE HERALD RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/27561/ To: JIRA, navis

          People

          • Assignee:
            Navis
            Reporter:
            Navis
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development