Hive
  1. Hive
  2. HIVE-5601

NPE in ORC's PPD when using select * from table with where predicate

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.13.0, 0.12.1
    • Component/s: None
    • Labels:

      Description

      ORCInputFormat has a method findIncludedColumns() which returns boolean array of included columns. In case of the following query

      select * from qlog_orc where id<1000 limit 10;

      where all columns are selected the findIncludedColumns() returns null. This will result in a NPE when PPD is enabled. Following is the stack trace

      Caused by: java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.planReadPartialDataStreams(RecordReaderImpl.java:2387)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readPartialDataStreams(RecordReaderImpl.java:2543)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readStripe(RecordReaderImpl.java:2200)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceStripe(RecordReaderImpl.java:2573)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceToNextRow(RecordReaderImpl.java:2615)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.<init>(RecordReaderImpl.java:132)
      	at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.rows(ReaderImpl.java:348)
      	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.<init>(OrcInputFormat.java:99)
      	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:241)
      	at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
      	... 8 more
      1. HIVE-5601.5.patch.txt
        9 kB
        Prasanth J
      2. HIVE-5601.4-branch-0.12.patch.txt
        10 kB
        Prasanth J
      3. HIVE-5601.trunk.5.patch.txt
        9 kB
        Prasanth J
      4. HIVE-5601.trunk.4.patch.txt
        9 kB
        Prasanth J
      5. HIVE-5601.branch-0.12.4.patch.txt
        10 kB
        Prasanth J
      6. HIVE-5601.branch-0.12.3.patch.txt
        9 kB
        Prasanth J
      7. HIVE-5601.trunk.3.patch.txt
        6 kB
        Prasanth J
      8. HIVE-5601.branch-0.12.2.patch.txt
        1 kB
        Prasanth J
      9. HIVE-5601.trunk.2.patch.txt
        1 kB
        Prasanth J
      10. HIVE-5601.trunk.1.patch.txt
        0.7 kB
        Prasanth J
      11. HIVE-5601.branch-12.1.patch.txt
        0.7 kB
        Prasanth J

        Activity

          People

          • Assignee:
            Prasanth J
            Reporter:
            Prasanth J
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development