[PIG-3975] Multiple Scalar reference calls leading to missing records

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.8.1, 0.9.2, 0.10.1, 0.11.1, 0.12.2
• Fix Version/s: 0.13.0
• Assignee: Koji Noguchi
• Reporter: Koji Noguchi
• Created: 30/May/14 21:29
• Updated: 07/Jul/14 18:08
• Resolved: 20/Jun/14 21:57

Description

We noticed that multiple pig runs with same input were producing different outputs.

Simplified script looked like this.

A = load 'input1' as (a1:int);
B = group A by a1 parallel 200;
C = load 'input2' as (c1:int);
D = foreach C generate B.$0;
store D into '/tmp/deletemeD';
E = load 'input3' as (c1:int);
F = foreach E generate B.$0;
store F into '/tmp/deletemeF';