[PIG-1963] in nested foreach, accumutive udf taking input from order-by does not get results in order

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0, 0.9.0
• Fix Version/s: 0.8.1
• Assignee: Thejas Nair
• Reporter: Thejas Nair
• Created: 04/Apr/11 22:18
• Updated: 25/Apr/11 21:27
• Resolved: 08/Apr/11 19:30

Description

This happens only when secondary sort is not being used for the order-by.
For example -

a1 = load 'fruits.txt' as (f1:int,f2);
a2 = load 'fruits.txt' as (f1:int,f2);

b = cogroup a1 by f1, a2 by f1;

d = foreach b {
   sort1 = order a1 by f2;
   sort2 = order a2 by f2; -- secondary sort not getting used here, MYCONCATBAG gets results in wrong order
   generate group, MYCONCATBAG(sort1.f1), MYCONCATBAG(sort2.f2);
}

-- explain d;
dump d;