Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-5341

PigStorage with -tagFile/-tagPath produces incorrect results with column pruning

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.17.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I don't know why we didn't see this till now.

      A = load 'test.txt' using PigStorage('\t', '-tagFile') as (filename:chararray, a0:int, a1:int, a2:int, a3:int);
      B = FOREACH A GENERATE a0,a2;
      dump B;
      

      Input

      knoguchi@pig > cat  test.txt
      0       1       2       3
      0       1       2       3
      0       1       2       3
      

      Expected Results

      (0,2)
      (0,2)
      (0,2)
      

      Actual Results

      (,1)
      (,1)
      (,1)
      

      This is really bad...

        Attachments

          Activity

            People

            • Assignee:
              knoguchi Koji Noguchi
              Reporter:
              knoguchi Koji Noguchi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: