[PIG-749] No attempt to check if 'flatten(group) as' has the same cardinality as 'group alias by'

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.3.0
• Fix Version/s: 0.9.0
• Component/s: grunt
• Assignee: Alan Gates
• Reporter: Viraj Bhat
• Created: 02/Apr/09 22:40
• Updated: 04/Aug/11 00:34
• Resolved: 24/Dec/10 02:33

Description

Pig script which does grouping for 3 columns and flattens as 4 columns works when in principle it should not and maybe fail as a front-end error.

A = load 'groupcardinalitycheck.txt' using PigStorage() as (col1:chararray, col2:chararray, col3:int, col4:chararray);

B = group A by (col1, col2, col3);

C = foreach B generate
           flatten(group) as (col1, col2, col3, col4),
           SIZE(A) as frequency;

dump C;

==========================================================================================
Data
==========================================================================================
hello CC 1 there
hello YSO 2 out
ouch CC 2 hey
==========================================================================================
Result of the preceding script
==========================================================================================
(ouch,CC,2,1L)
(hello,CC,1,1L)
(hello,YSO,2,1L)
==========================================================================================