[PIG-5341] PigStorage with -tagFile/-tagPath produces incorrect results with column pruning

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.17.1
• Hadoop Flags: Reviewed
• Assignee: Koji Noguchi
• Reporter: Koji Noguchi
• Created: 04/Jun/18 20:42
• Updated: 05/Jun/18 14:35
• Resolved: 05/Jun/18 14:35

Description

I don't know why we didn't see this till now.

A = load 'test.txt' using PigStorage('\t', '-tagFile') as (filename:chararray, a0:int, a1:int, a2:int, a3:int);
B = FOREACH A GENERATE a0,a2;
dump B;

Input

knoguchi@pig > cat  test.txt
0       1       2       3
0       1       2       3
0       1       2       3

Expected Results

(0,2)
(0,2)
(0,2)

Actual Results

(,1)
(,1)
(,1)

This is really bad...