[MAPREDUCE-787] -files, -archives should honor user given symlink path

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.21.0
• Component/s: client
• Hadoop Flags: Reviewed
• Release Note: Fix JobSubmitter to honor user given symlink in the path.
• Assignee: Amareshwari Sriramadasu
• Reporter: Amareshwari Sriramadasu
• Created: 22/Jul/09 11:11
• Updated: 24/Aug/10 21:14
• Resolved: 27/Nov/09 10:56

Description

Currently, if user gives an option such as
-files hdfs://host:fs_port/user/testfile.txt#testlink
The symlink name "testlink" is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task.

If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used.

Issue Links

• incorporates: MAPREDUCE-752 DistributedCache.addArchiveToClassPath doesn't work
• is blocked by: HADOOP-6334 GenericOptionsParser does not understand uri for -files -libjars and -archives option
• relates to: HADOOP-6333 Generic options parser eats up IOException during parsing of -files, -libjars and -archives