[PIG-248] Pig Local give wrong results

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.2.0

Environment

Pig Local

• Assignee: Pradeep Kamath
• Reporter: Amir Youssefi
• Created: 24/May/08 02:36
• Updated: 02/May/13 02:29
• Resolved: 26/Jan/09 20:52

Description

Pig Local mode gives wrong results (but Pig + Hadoop give correct results) . This created issues for users who tried to debug in local mode...

Here's my pig code:

a = load '/homes/amiry/tmp/my_test.txt' as (c1,c2,c3);
b = group a by c1;
c = foreach b {
d = order a by c3;
generate d;
}
dump c;

Pig + Hadoop:

(

{(abc, http://www.sss.net, a), (abc, http://www.rrr.com, b)}

)
(

{(def, http://local.yahoo.com/, d), (def, http://lmn.com/, f), (def, http://xyz.com/, g)}

)

Pig Local:
(

{(abc, http://www.sss.net, a), (abc, http://www.rrr.com, b)}

)
({})

Input:

abc http://www.rrr.com b
abc http://www.sss.net a
def http://local.yahoo.com/ d
def http://lmn.com/ f
def http://xyz.com/ g

Issue Links

• depends upon: PIG-157 Add types and rework execution pipeline