Uploaded image for project: 'Crunch'
  1. Crunch
  2. CRUNCH-565

CSVInputFormat needs to be more defensive when configuring itself

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.10.0, 0.8.3
    • Fix Version/s: 0.14.0
    • Component/s: Core
    • Labels:

      Description

      It seems that some behavior has changed somewhere along the line where hadoop Configuration is concerned. It is possible that a call to .get(OPTION) will return null. CSVInputFormat does not handle that case gracefully:

      https://github.com/apache/crunch/blob/apache-crunch-0.10.0/crunch-core/src/main/java/org/apache/crunch/io/text/csv/CSVInputFormat.java#L178-L183

      Some more relevant details can be found in this JIRA:
      https://issues.apache.org/jira/browse/CRUNCH-564?focusedCommentId=14938186&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14938186

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                champgm mac champion
                Reporter:
                champgm mac champion
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: