Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-461

Ensure the CombineFileInputFormat is configured w/inputConf properties on a Source

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.8.4, 0.11.0
    • None
    • None

    Description

      Ran into an issue where the mapred.min.split.size wasn't being respected by the CombineFileInputFormat when it was specified via the inputConf options on the Source. This happens b/c the CombineFileInputFormat doesn't use the version of the JobContext that has been configured w/the Source-specific inputConf information. The fix is tiny.

      Attachments

        1. CRUNCH-461.patch
          1 kB
          Josh Wills

        Activity

          People

            Unassigned Unassigned
            jwills Josh Wills
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: