Pig
  1. Pig
  2. PIG-1993

PigStorageSchema throw NPE with ColumnPruning

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0, 0.9.0
    • Fix Version/s: 0.8.1
    • Component/s: impl
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The following script fail:

      a = load '1.txt' as (a0:int, a1:int, a2:int);
      store a into 'temp' using org.apache.pig.piggybank.storage.PigStorageSchema();
      exec
      a = LOAD 'temp' using org.apache.pig.piggybank.storage.PigStorageSchema();
      b = FOREACH a GENERATE a1;
      dump b;
      

      Error message:
      java.lang.ArrayIndexOutOfBoundsException: 2
      at org.apache.pig.piggybank.storage.PigStorageSchema.getNext(PigStorageSchema.java:94)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:187)
      at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:423)
      at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
      at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
      at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)

      1. PIG-1993-0.patch
        0.9 kB
        Daniel Dai
      2. PIG-1993-1.patch
        3 kB
        Daniel Dai

        Activity

        Daniel Dai made changes -
        Fix Version/s 0.8.1 [ 12316393 ]
        Fix Version/s 0.8.0 [ 12314562 ]
        Fix Version/s 0.9.0 [ 12315191 ]
        Daniel Dai made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Daniel Dai made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Olga Natkovich made changes -
        Assignee Daniel Dai [ daijy ]
        Daniel Dai made changes -
        Attachment PIG-1993-1.patch [ 12476201 ]
        Daniel Dai made changes -
        Fix Version/s 0.8.0 [ 12314562 ]
        Affects Version/s 0.8.0 [ 12314562 ]
        Daniel Dai made changes -
        Field Original Value New Value
        Attachment PIG-1993-0.patch [ 12476196 ]
        Daniel Dai created issue -

          People

          • Assignee:
            Daniel Dai
            Reporter:
            Daniel Dai
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development