Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-446

Problem when schema contains more columns that actual data

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.2.0
    • 0.2.0
    • None
    • None

    Description

      Script:

      – extra1 and extra2 are not present in the data
      A = load 'data' as (name, age: int, gpa, extra1, extra2);
      B = limit A 10;
      dump B;

      Error:

      Out of bounds access: Request for field number 3 exceeds tuple size of 3
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:223)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:121)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

      Attachments

        1. PIG-446.patch
          2 kB
          Alan Gates

        Activity

          People

            gates Alan Gates
            olgan Olga Natkovich
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: