[PIG-2494] Improvement to SequenceFileLoader (NullWritable and Delimiter)

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.9.1
• Component/s: piggybank
• Labels: newbie simple

Environment

All

• Release Note: Should have no compatible issues
• Tags: SequenceFileLoader NullWritable Delimiter
• Assignee: Unassigned
• Reporter: Ted Malaska
• Created: 29/Jan/12 13:30
• Updated: 04/Sep/12 21:37

Description

I wanted to add two features to SequenceFileLoader.
1. I added a delimiter so it will act more like PigStorage, in that it will Split the value if it is a type Text (chararray).
2. I added the option of the key being a NullWritable. I wanted to be able to process my Hive files in both Hive and Pig, but because my Hive sequence files have a NullWritable key I could not make this work with the current implementation of SequenceFileLoader.

My change is attached to this Issue.