Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
None
-
None
-
None
Description
In both methods (addFileToClassPath & addArchiveToClassPath) you can specify a path. If this path is fully qualified (hdfs:///....) the files are not in the job classpath.
(since the : in the path is also used as path separator).
So i think with one of the following simple improvements:
- throw an exception if the specified path is fully qualified
- OR disqualify the path (f.e. with new Path(path.toUri().getPath()))
people would have an easier start with the DistributedCache!
Attachments
Issue Links
- is related to
-
MAPREDUCE-2361 Distributed Cache is not adding files to class paths correctly
- Open
-
MAPREDUCE-752 DistributedCache.addArchiveToClassPath doesn't work
- Resolved