[MAPREDUCE-1581] DistributedCache#addXxxToClassPath() fails silently if qualified pathes are passed in

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: distributed-cache
• Assignee: Unassigned
• Reporter: Johannes Zillmann
• Created: 09/Mar/10 10:43
• Updated: 11/Mar/11 04:51

Description

In both methods (addFileToClassPath & addArchiveToClassPath) you can specify a path. If this path is fully qualified (hdfs:///....) the files are not in the job classpath.
(since the : in the path is also used as path separator).

So i think with one of the following simple improvements:

• throw an exception if the specified path is fully qualified
• OR disqualify the path (f.e. with new Path(path.toUri().getPath()))

people would have an easier start with the DistributedCache!

Issue Links

• is related to: MAPREDUCE-2361 Distributed Cache is not adding files to class paths correctly
• is related to: MAPREDUCE-752 DistributedCache.addArchiveToClassPath doesn't work