[MAPREDUCE-3505] yarn APPLICATION_CLASSPATH needs to be overridable

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.1
• Component/s: mrv2
• Labels: bigtop
• Hadoop Flags: Reviewed
• Assignee: Ahmed Radwan
• Reporter: Bruno Mahé
• Created: 02/Dec/11 23:59
• Updated: 05/Mar/12 02:49
• Resolved: 24/Jan/12 18:26

Description

Right now MRApps sets the classpath to just being mrapp-generated-classpath, its content and a hardcoded list of directories.
If I understand correctly mrapp-generated-classpath is only there for testing and may change or disappear at any time

The list of hardcoded directories is defined in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java at line 92.
For convenience, here is its current content:

  /**
   * Classpath for typical applications.
   */
  public static final String[] APPLICATION_CLASSPATH =
      new String[] {
        "$HADOOP_CONF_DIR",
        "$HADOOP_COMMON_HOME/share/hadoop/common/*",
        "$HADOOP_COMMON_HOME/share/hadoop/common/lib/*",
        "$HADOOP_HDFS_HOME/share/hadoop/hdfs/*",
        "$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*",
        "$YARN_HOME/modules/*",
        "$YARN_HOME/lib/*"
      };

Not all deployment scenarii fit in this layout and therefore we need a standardized way to customize this class path.

Issue Links

• relates to: MAPREDUCE-3389 MRApps loads the 'mrapp-generated-classpath' file with classpath from the build machine