[MAPREDUCE-5813] YarnChild does not load job.xml with mapreduce.job.classloader=true

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.4.0
• Component/s: mrv2, task
• Target Version/s: 2.4.0
• Assignee: Gera Shegalov
• Reporter: Gera Shegalov
• Created: 27/Mar/14 11:47
• Updated: 02/Jul/14 10:21
• Resolved: 29/Mar/14 19:16

Description

YarnChild.main uses JobConf.addResource(String) to load job.xml that relies on class loading. When mapreduce.job.classloader=true the job-speicific part of the class path is separated from CLASSPATH into APP_CLASSPATH. Therefore job.xml is inaccessible for the default class loader. Later writeLocalJobFile overwrites the correct localized job.xml on disk as well.

This problem is easily avoided by using JobConf.addResource(Path) to read the localized job.xml without relying on class loading.

Issue Links

• is broken by: MAPREDUCE-5805 Unable to parse launch time from job history file
• is related to: MAPREDUCE-5957 AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used