Details
-
Bug
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
2.2.0
-
None
-
None
Description
In YARNRunner.java, line 357,
Path jobJarPath = new Path(jobConf.get(MRJobConfig.JAR));
This causes the job.jar file to miss scheme, host and port number on distributed file systems other than hdfs.
If we compare line 357 with line 344, there "job.xml" is actually set as
Path jobConfPath = new Path(jobSubmitDir,MRJobConfig.JOB_CONF_FILE);
It appears "jobSubmitDir" is missing on line 357, which causes this problem. In hdfs, the additional qualify process will correct this problem, but not other generic distributed file systems.
The proposed change is to replace 35 7 with
Path jobJarPath = new Path(jobConf.get(jobSubmitDir,MRJobConfig.JAR));