[YARN-728] Yarn and MR default classpath are wrong on Windows

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.0.0-alpha1

Environment

Windows

• Assignee: Unassigned
• Reporter: Mostafa Elhemali
• Created: 28/May/13 22:41
• Updated: 12/May/16 18:30
• Resolved: 21/Aug/14 20:16

Description

On Windows, the environment variables need to be used as %X% not $X as in Linux/Unix. This is handled in code in Yarn in the ApplicationConstants$Environment.$() method. However there are two problems in Windows today where this doesn't work:

1. In yarn-default.xml and mapred-default.xml, the yarn.application.classpath and mapreduce.application.classpath are defined with hard-coded values that use the Linux form (e.g. $HADOOP_CONF_HOME).
2. In MRJobConfig, the DEFAULT_MAPREDUCE_APPLICATION_CLASSPATH constant is defined using the Linux form for HADOOP_MAPRED_HOME: $HADOOP_MAPRED_HOME.

This causes MR applications to fail on Windows because it can't find the MRAppMaster class because the classpath is wrong.

Issue Links

• duplicates: YARN-1138 yarn.application.classpath is set to point to $HADOOP_CONF_DIR etc., which does not work on Windows