Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-787

-files, -archives should honor user given symlink path

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • client
    • None
    • Reviewed
    • Fix JobSubmitter to honor user given symlink in the path.

    Description

      Currently, if user gives an option such as
      -files hdfs://host:fs_port/user/testfile.txt#testlink
      The symlink name "testlink" is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task.

      If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used.

      Attachments

        1. patch-787.txt
          8 kB
          Amareshwari Sriramadasu
        2. patch-787-1.txt
          10 kB
          Amareshwari Sriramadasu
        3. patch-787-1-ydist.txt
          26 kB
          Amareshwari Sriramadasu
        4. patch-787-2.txt
          12 kB
          Amareshwari Sriramadasu
        5. patch-787-3.txt
          12 kB
          Amareshwari Sriramadasu
        6. patch-787-3.txt
          12 kB
          Amareshwari Sriramadasu
        7. patch-787-ydist.txt
          25 kB
          Amareshwari Sriramadasu
        8. patch-787-ydist.txt
          26 kB
          Amareshwari Sriramadasu

        Issue Links

          incorporates

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-752 DistributedCache.addArchiveToClassPath doesn't work

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-6334 GenericOptionsParser does not understand uri for -files -libjars and -archives option

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-6333 Generic options parser eats up IOException during parsing of -files, -libjars and -archives

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              amareshwari Amareshwari Sriramadasu
              amareshwari Amareshwari Sriramadasu
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: