[PIG-3141] Giving CSVExcelStorage an option to handle header rows

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.11
• Fix Version/s: 0.12.0
• Component/s: piggybank
• Patch Info: Patch Available
• Assignee: Jonathan Packer
• Reporter: Jonathan Packer
• Created: 28/Jan/13 20:37
• Updated: 14/Oct/13 16:46
• Resolved: 26/Mar/13 04:40

Description

Adds an argument to CSVExcelStorage to skip the header row when loading. This works properly with multiple small files each with a header being combined into one split, or a large file with a single header being split into multiple splits.

Also fixes a few bugs with CSVExcelStorage, including PIG-2470 and a bug involving quoted fields at the end of a line not escaping properly.

Issue Links

• incorporates: PIG-2470 Issue with CSVEXcelStorage piggy bank function