[MAPREDUCE-752] DistributedCache.addArchiveToClassPath doesn't work

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.1, 0.21.0
• Component/s: distributed-cache
• Assignee: Unassigned
• Reporter: Vladimir Klimontovich
• Created: 12/Jul/09 13:24
• Updated: 23/Jul/14 19:18
• Resolved: 23/Jul/14 19:18

Description

addArchiveToClassPath is a method of DistributedCache class. It should be called before running a task. It accepts path to a jar file on a DFS. After it
this method should put this jar file on sitribuuted cache and than add this file to classpath to each map/reduce process on job tracker.

This method don't work:

in TaskRunner there is an algorithm that looks for correspondence between DFS paths and local paths in distributed cache.
It compares

if (archives[i].getPath().equals(
archiveClasspaths[j].toString())){

instead of

if (archives[i].toString().equals(
archiveClasspaths[j].toString()))

Issue Links

• incorporates: HADOOP-6140 DistributedCache.addArchiveToClassPath doesn't work in 0.18.x branch
• is part of: MAPREDUCE-787 -files, -archives should honor user given symlink path
• relates to: MAPREDUCE-2361 Distributed Cache is not adding files to class paths correctly
• relates to: MAPREDUCE-1581 DistributedCache#addXxxToClassPath() fails silently if qualified pathes are passed in