[CRUNCH-632] Add compression support for CSVFileSource

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.15.0
• Assignee: Micah Whitacre
• Reporter: Jim McStanton
• Created: 09/Jan/17 20:23
• Updated: 26/Feb/17 18:33
• Resolved: 31/Jan/17 01:24

Description

Currently CSVFileSource does not support decompressing files before reading them, and simply opens the file and starts reading the contents: https://github.com/apache/crunch/blob/6280983179e9c690af69c2bf0e296b054122d724/crunch-core/src/main/java/org/apache/crunch/io/text/csv/CSVRecordReader.java#L127.

This source would more closely match TextFileSource if this support was added. The LineRecordReader supports this behavior here.