[PIG-3088] Add a builtin udf which removes prefixes

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Jonathan Coveney
• Reporter: Jonathan Coveney
• Created: 10/Dec/12 23:24
• Updated: 27/Oct/13 01:52

Description

This is something that I always hear people complaining about. Note that this depends on the FlattenOutput annotation.

This UDF supports the following.

a = load 'a' as (x1, y1, z1);
b = load 'a' as (x2, y2, z2);
c = join a by x1, b by x2;
describe c;
--c: {a::x1: bytearray,a::y1: bytearray,a::z1: bytearray,b::x2: bytearray,b::y2: bytearray,b::z2: bytearray}

d = foreach c generate RemovePrefix(*);
describe d;
--d: {x1: bytearray,y1: bytearray,z1: bytearray,x2: bytearray,y2: bytearray,z2: bytearray}

Issue Links

• depends upon: PIG-3010 Allow UDF's to flatten themselves