Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1806

CombineFileInputFormat does not work with paths not on default FS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0, 0.23.1
    • 1.2.0, 2.0.3-alpha, 0.23.5
    • harchive
    • None
    • Reviewed

    Description

      In generating the splits in CombineFileInputFormat, the scheme and authority are stripped out. This creates problems when trying to access the files while generating the splits, as without the har:/, the file won't be accessed through the HarFileSystem.

      Attachments

        1. MAPREDUCE-1806-branch-1.rev1.patch
          3 kB
          Sandy Ryza
        2. MAPREDUCE-1806-branch-1.patch
          3 kB
          Sandy Ryza
        3. MAPREDUCE-1806.rev4.patch
          4 kB
          Sandy Ryza
        4. MAPREDUCE-1806.rev3.patch
          3 kB
          Gera Shegalov
        5. MAPREDUCE-1806.rev2.patch
          3 kB
          Gera Shegalov
        6. MAPREDUCE-1806.patch
          1.0 kB
          Gera Shegalov

        Issue Links

          Activity

            People

              jira.shegalov Gera Shegalov
              pauly Paul Yang
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: