Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1806

CombineFileInputFormat does not work with paths not on default FS

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0, 0.23.1
    • Fix Version/s: 1.2.0, 2.0.3-alpha, 0.23.5
    • Component/s: harchive
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In generating the splits in CombineFileInputFormat, the scheme and authority are stripped out. This creates problems when trying to access the files while generating the splits, as without the har:/, the file won't be accessed through the HarFileSystem.

        Attachments

        1. MAPREDUCE-1806.rev4.patch
          4 kB
          Sandy Ryza
        2. MAPREDUCE-1806-branch-1.rev1.patch
          3 kB
          Sandy Ryza
        3. MAPREDUCE-1806-branch-1.patch
          3 kB
          Sandy Ryza
        4. MAPREDUCE-1806.rev3.patch
          3 kB
          Gera Shegalov
        5. MAPREDUCE-1806.rev2.patch
          3 kB
          Gera Shegalov
        6. MAPREDUCE-1806.patch
          1.0 kB
          Gera Shegalov

          Issue Links

            Activity

              People

              • Assignee:
                jira.shegalov Gera Shegalov
                Reporter:
                pauly Paul Yang
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: