[PIG-3000] Optimize nested foreach

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.10.0
• Component/s: impl
• Assignee: Rohini Palaniswamy
• Reporter: Richard Ding
• Created: 24/Oct/12 00:21
• Updated: 15/Jun/18 15:36

Description

In this Pig script:

A = load 'data' as (a:chararray);
B = foreach A { c = UPPER(a); generate ((c eq 'TEST') ? 1 : 0), ((c eq 'DEV') ? 1 : 0); }

The Eval function UPPER is called twice for each record.

This should be optimized so that the UPPER is called only once for each record

Issue Links

• is part of: PIG-5256 Bytecode generation for POFilter and POForeach
• relates to: PIG-1633 Using an alias withing Nested Foreach causes indeterminate behaviour
• links to: Reviewboard