[PIG-2123] Support scalar relationship in nested foreach

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Gianmarco De Francisci Morales
• Created: 14/Jun/11 12:09
• Updated: 14/Jun/11 12:09

Description

It would be nice to have the possibility to compute and use scalar relationship inside a nested foreach block.

As an example, the following code is not currently supported by Pig.

a = LOAD 'data.txt' AS (id:chararray, num:int);                                                      
b = GROUP a BY id; 
c = FOREACH b { n = COUNT(a); d = FILTER a BY num == n; GENERATE d; };

This would be useful with LIMIT and SAMPLE as well.