[MAPREDUCE-5459] Update the doc of running MRv1 examples jar on YARN

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Assignee: Zhijie Shen
• Reporter: Zhijie Shen
• Created: 14/Aug/13 21:05
• Updated: 30/Jun/15 07:18
• Resolved: 02/Oct/13 21:10

Description

In addition to adding two env vars: HADOOP_USER_CLASSPATH_FIRST and HADOOP_CLASSPATH, we still need to add

    <property>
        <name>mapreduce.job.user.classpath.first</name>
        <value>true</value>
    </property>

in mapred-site.xml to make sure that the MRv1 examples jar runs correctly on YARN. Some examples will use Java reflection to find the classes in the examples jar dynamically when they are running. With this configuration, the MRv1 examples jar will appear before the MRv2 examples jar in CLASSPATH of the processes in YARN containers. Therefore, the classes found via reflection will be picked from MRv1 examples jar instead of MRv2 examples jar as well.

MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm needs to be updated to document this.

Issue Links

• relates to: MAPREDUCE-5184 Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2