Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1795

Task.moveTaskOutputs is escaping special characters in output filenames

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.14.0
    • 0.15.0
    • None
    • None

    Description

      after a migration from 0.10.1 to 0.14.0, jobs can't generate output files with special characters in their name, just like '[' or ']' for example, because they are escaped during the Task.moveTaskOutputs process.

      For example, if you try to generate an output file named /foo/bar[0], it ends up being named /foo/bar%5B0%5B.

      The culprit is Task.getFinalPath(), when it does relativePath.toString(), where I think it should do relativePath.getPath().

      Attachments

        1. HADOOP-1795.patch
          6 kB
          Frédéric Bertin

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            fred.bertin Frédéric Bertin
            fred.bertin Frédéric Bertin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment