[CRUNCH-565] CSVInputFormat needs to be more defensive when configuring itself

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.10.0, 0.8.3
• Fix Version/s: 0.14.0
• Component/s: Core
• Labels: csv csvparser
• Assignee: mac champion
• Reporter: mac champion
• Created: 30/Sep/15 18:09
• Updated: 08/May/16 04:14
• Resolved: 05/Oct/15 19:14

Description

It seems that some behavior has changed somewhere along the line where hadoop Configuration is concerned. It is possible that a call to .get(OPTION) will return null. CSVInputFormat does not handle that case gracefully:

https://github.com/apache/crunch/blob/apache-crunch-0.10.0/crunch-core/src/main/java/org/apache/crunch/io/text/csv/CSVInputFormat.java#L178-L183

Some more relevant details can be found in this JIRA:
https://issues.apache.org/jira/browse/CRUNCH-564?focusedCommentId=14938186&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14938186

Issue Links

• relates to: CRUNCH-362 Add a CSV File Source
• relates to: CRUNCH-564 Add support for using escape character same as open/close quote character