[MAPREDUCE-4421] Run MapReduce framework via the distributed cache

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 2.3.0
• Hadoop Flags: Reviewed
• Assignee: Jason Darrell Lowe
• Reporter: Arun Murthy
• Created: 10/Jul/12 13:12
• Updated: 25/Nov/14 16:37
• Resolved: 01/Oct/13 22:40

Description

Currently MR AM depends on MR jars being deployed on all nodes via implicit dependency on YARN_APPLICATION_CLASSPATH.

We should stop adding mapreduce jars to YARN_APPLICATION_CLASSPATH and, probably, just rely on adding a shaded MR jar along with job.jar to the dist-cache.

Issue Links

• is related to: YARN-2464 Provide Hadoop as a local resource (on HDFS) which can be used by other projects
• is related to: MAPREDUCE-5534 Improve job configuration handling when MapReduce deployed via HDFS
• is related to: MAPREDUCE-6173 Document the configuration of deploying MR over distributed cache with enabling wired encryption at the same time
• is related to: YARN-666 [Umbrella] Support rolling upgrades in YARN