[MAPREDUCE-5558] Scheme for local file is lost when submitting mapreduce job using mapreduce API

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Later
• Affects Version/s: 2.1.0-beta, 2.1.1-beta, 2.2.0
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 03/Oct/13 20:42
• Updated: 15/Dec/14 16:52
• Resolved: 04/Oct/13 21:06

Description

HBase snapshot export adds dependent jars (local files) through "tmpjars" config entry.

When debugging HBASE-9687, we found that scheme for local file (file://) is lost by DistributedCache.addFileToClassPath() call in JobSubmitter.

The root cause of this problem is that we are somehow losing "file://" from the uri. In the earlier code we were creating new Path object (new Path (newPath.toUri().getPath()) ) where as part of newPath.toUri().getPath() call we are losing the authority and scheme which are passed in.

Thanks to Omkar and Vinod who helped debug this issue