Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4744

Unary Minus Expression Throwing java.lang.NullPointerException

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • vectorization-branch
    • vectorization-branch, 0.13.0
    • None
    • None

    Description

      SELECT   L_QUANTITY,
               L_RETURNFLAG,
               (L_QUANTITY * -2),
               (L_QUANTITY % L_SUPPKEY),
               (-(L_TAX))
      FROM     lineitem_orc
      WHERE    ((L_QUANTITY < L_TAX)
                OR (L_TAX > L_ORDERKEY))
      ORDER BY L_QUANTITY;
      

      Executed over tcpch lineitem generated at a scale factor of 1gb

      13/06/15 03:27:21 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
      
      Logging initialized using configuration in file:/C:/Hadoop/hive-0.9.0/conf/hive-log4j.properties
      
      Hive history file=c:\hadoop\hive-0.9.0\logs\history/hive_job_log_jenkinsuser_4280@SLAVE23-WIN_201306150327_1960387810.txt
      
      Total MapReduce jobs = 1
      
      Launching Job 1 out of 1
      Number of reduce tasks determined at compile time: 1
      In order to change the average load for a reducer (in bytes):
        set hive.exec.reducers.bytes.per.reducer=<number>
      In order to limit the maximum number of reducers:
        set hive.exec.reducers.max=<number>
      In order to set a constant number of reducers:
        set mapred.reduce.tasks=<number>
      
      java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getUnaryMinusExpression(VectorizationContext.java:327)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getVectorExpression(VectorizationContext.java:440)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getVectorExpression(VectorizationContext.java:397)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getVectorExpression(VectorizationContext.java:248)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.initializeOp(VectorSelectOperator.java:73)
      	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
      	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
      	at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
      
      	at org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator.initializeOp(VectorFilterOperator.java:76)
      	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
      	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
      	at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
      	at org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:187)
      	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
      	at org.apache.hadoop.hive.ql.exec.ExecDriver.validateVectorOperator(ExecDriver.java:580)
      	at org.apache.hadoop.hive.ql.exec.ExecDriver.validateVectorPath(ExecDriver.java:568)
      	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:287)
      
      	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:138)
      	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:145)
      	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
      	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1355)
      	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1139)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:945)
      	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
      	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
      	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
      	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:348)
      	at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:446)
      
      	at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:456)
      	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:712)
      	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
      
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      	at java.lang.reflect.Method.invoke(Method.java:597)
      	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
      
      

      Attachments

        1. HIVE-4744.1.patch
          8 kB
          Jitendra Nath Pandey
        2. HIVE-4744.2.patch
          12 kB
          Jitendra Nath Pandey
        3. HIVE-4744.3.patch
          12 kB
          Jitendra Nath Pandey

        Activity

          People

            jnp Jitendra Nath Pandey
            anthony.murphy Tony Murphy
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: