[CRUNCH-362] Add a CSV File Source

• Type: Improvement
• Status: Closed
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 0.9.0, 0.8.2
• Fix Version/s: 0.10.0, 0.8.3
• Component/s: Core
• Labels: csv csvparser inputformat
• Assignee: mac champion
• Reporter: mac champion
• Created: 28/Feb/14 22:59
• Updated: 30/Sep/15 18:09
• Resolved: 21/May/14 19:10

Description

CSV files can be unpredictable. Among other quirks, it is possible for a single CSV record to span multiple lines in a file. In cases like these, TextFileSource is not effective and NLineFileSource is not flexible enough.

The result of this JIRA should be a CSVFileSource which, at minimum, should be able to deal with multiple-line CSV records.

Issue Links

• is related to: CRUNCH-429 The CSVFileSource does not always function properly
• is related to: CRUNCH-565 CSVInputFormat needs to be more defensive when configuring itself
• is related to: CRUNCH-414 The CSV file source needs to be a little more robust when handling multi-line CSV files