[PIG-836] Allow setting of end-of-record delimiter in PigStorage

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: impl
• Assignee: Benjamin Reed
• Reporter: George Mavromatis
• Created: 05/Jun/09 05:07
• Updated: 05/May/15 21:17
• Resolved: 21/Sep/10 21:16

Description

PigStorage allows overriding the default field delimiter ('\t'), but does not allow overriding the record delimiter ('\n').

It is a valid use case that fields contain new lines, e.g. because they are contents of a document/web page. It is possible for the user to create a custom load/store UDF to achieve that, but that is extra work on the user, many users will have to do it , and that udf would be the exact code duplicate of the PigStorage except for the delimiter.

Thus, PigStorage() should allow to configure both field and record separators.