Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1993

PigStorageSchema throw NPE with ColumnPruning

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.0, 0.9.0
    • 0.8.1
    • impl
    • None
    • Reviewed

    Description

      The following script fail:

      a = load '1.txt' as (a0:int, a1:int, a2:int);
      store a into 'temp' using org.apache.pig.piggybank.storage.PigStorageSchema();
      exec
      a = LOAD 'temp' using org.apache.pig.piggybank.storage.PigStorageSchema();
      b = FOREACH a GENERATE a1;
      dump b;
      

      Error message:
      java.lang.ArrayIndexOutOfBoundsException: 2
      at org.apache.pig.piggybank.storage.PigStorageSchema.getNext(PigStorageSchema.java:94)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:187)
      at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:423)
      at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
      at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
      at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)

      Attachments

        1. PIG-1993-0.patch
          0.9 kB
          Daniel Dai
        2. PIG-1993-1.patch
          3 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: