Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-787

-files, -archives should honor user given symlink path

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • client
    • None
    • Reviewed
    • Fix JobSubmitter to honor user given symlink in the path.

    Description

      Currently, if user gives an option such as
      -files hdfs://host:fs_port/user/testfile.txt#testlink
      The symlink name "testlink" is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task.

      If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used.

      Attachments

        1. patch-787.txt
          8 kB
          Amareshwari Sriramadasu
        2. patch-787-1.txt
          10 kB
          Amareshwari Sriramadasu
        3. patch-787-1-ydist.txt
          26 kB
          Amareshwari Sriramadasu
        4. patch-787-2.txt
          12 kB
          Amareshwari Sriramadasu
        5. patch-787-3.txt
          12 kB
          Amareshwari Sriramadasu
        6. patch-787-3.txt
          12 kB
          Amareshwari Sriramadasu
        7. patch-787-ydist.txt
          25 kB
          Amareshwari Sriramadasu
        8. patch-787-ydist.txt
          26 kB
          Amareshwari Sriramadasu

        Issue Links

        incorporates

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-752 DistributedCache.addArchiveToClassPath doesn't work

        • Major - Major loss of function.
        • Resolved
        is blocked by

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-6334 GenericOptionsParser does not understand uri for -files -libjars and -archives option

        • Major - Major loss of function.
        • Closed
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-6333 Generic options parser eats up IOException during parsing of -files, -libjars and -archives

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            amareshwari Amareshwari Sriramadasu
            amareshwari Amareshwari Sriramadasu
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment