[PIG-2717] Tuple field mangled during flattening

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.9.2, 0.10.0
• Fix Version/s: 0.11, 0.10.1

Environment

RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)

• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Brian Tan
• Created: 22/May/12 23:21
• Updated: 06/Jan/13 23:57
• Resolved: 30/May/12 22:58

Description

1.txt:
1, 2, 3
4, 5, 6
7, 8, 9

a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
b = foreach a generate TOTUPLE(x, y) as t, z;
c = group b by t;
d = foreach c generate flatten(b);
e = foreach d generate t;

Describing d shows the schema as d:

{b::t: (x: int,y: int),b::z: int}

However, when dumping d the output is
(1,3)
(4,6)
(7,9)

Describing e shows the schema as e:

{b::t: (x: int,y: int)}

However, when dumping I got the following error:
java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple