Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5601

NPE in ORC's PPD when using select * from table with where predicate

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.13.0, 0.12.1
    • Component/s: None
    • Labels:

      Description

      ORCInputFormat has a method findIncludedColumns() which returns boolean array of included columns. In case of the following query

      select * from qlog_orc where id<1000 limit 10;

      where all columns are selected the findIncludedColumns() returns null. This will result in a NPE when PPD is enabled. Following is the stack trace

      Caused by: java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.planReadPartialDataStreams(RecordReaderImpl.java:2387)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readPartialDataStreams(RecordReaderImpl.java:2543)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readStripe(RecordReaderImpl.java:2200)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceStripe(RecordReaderImpl.java:2573)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceToNextRow(RecordReaderImpl.java:2615)
      	at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.<init>(RecordReaderImpl.java:132)
      	at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.rows(ReaderImpl.java:348)
      	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.<init>(OrcInputFormat.java:99)
      	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:241)
      	at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
      	... 8 more

        Attachments

        1. HIVE-5601.trunk.5.patch.txt
          9 kB
          Prasanth Jayachandran
        2. HIVE-5601.trunk.4.patch.txt
          9 kB
          Prasanth Jayachandran
        3. HIVE-5601.trunk.3.patch.txt
          6 kB
          Prasanth Jayachandran
        4. HIVE-5601.trunk.2.patch.txt
          1 kB
          Prasanth Jayachandran
        5. HIVE-5601.trunk.1.patch.txt
          0.7 kB
          Prasanth Jayachandran
        6. HIVE-5601.branch-12.1.patch.txt
          0.7 kB
          Prasanth Jayachandran
        7. HIVE-5601.branch-0.12.4.patch.txt
          10 kB
          Prasanth Jayachandran
        8. HIVE-5601.branch-0.12.3.patch.txt
          9 kB
          Prasanth Jayachandran
        9. HIVE-5601.branch-0.12.2.patch.txt
          1 kB
          Prasanth Jayachandran
        10. HIVE-5601.5.patch.txt
          9 kB
          Prasanth Jayachandran
        11. HIVE-5601.4-branch-0.12.patch.txt
          10 kB
          Prasanth Jayachandran

          Activity

            People

            • Assignee:
              prasanth_j Prasanth Jayachandran
              Reporter:
              prasanth_j Prasanth Jayachandran
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: