[PIG-4683] Nested order is broken after PIG-3591 in some cases

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.16.0, 0.15.1
• Component/s: impl
• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Daniel Dai
• Created: 21/Sep/15 19:13
• Updated: 31/Aug/16 22:47
• Resolved: 24/Sep/15 05:46

Description

The following script fail after PIG-3591.

a = load '1.txt' using PigStorage(',') as (a0:chararray, a1:chararray);
b = load '2.txt' as (b0:chararray);
c = cogroup b by b0, a by a0;
d = foreach c {
    a_sorted = order a by a1 desc;
    generate group, a_sorted, b;
}
dump d;

1.txt
a,0
a,2
a,1

2.txt
a

Expected:

(a,{(a,1),(a,2),(a,0)},{(a)})

Actual:

(a,{(a,2),(a,1),(a,0),(a)},{})

Issue Links

• is duplicated by: PIG-4955 Difference in record counts for same pig script on same data
• is related to: PIG-3591 Refactor POPackage to separate MR specific code from packaging