[BIGTOP-1118] Update mapreduce.shuffle to mapreduce_shuffle in yarn configurations for Hadoop 2.2.0

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Component/s: general
• Assignee: Wenwu Peng
• Reporter: Mark Grover
• Created: 14/Oct/13 16:49
• Updated: 20/Mar/14 06:07
• Resolved: 20/Mar/14 05:44

Description

YARN-1229 went into Hadoop 2.2.0

We ship sample configurations for yarn in 2 places:
https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/conf.empty
https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/conf.pseudo

Once we have integrated Hadoop 2.2.0 in Bigtop, we need to update the yarn-site.xml in these locations with a patch like this:

 <configuration>
   <property>
     <name>yarn.nodemanager.aux-services</name>
-    <value>mapreduce.shuffle</value>
+    <value>mapreduce_shuffle</value>
   </property>
 
   <property>
-    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class&lt;/name>
+    <name>yarn.nodemanager.aux-services.mapreduce_shuffle.class&lt;/name>
     <value>org.apache.hadoop.mapred.ShuffleHandler</value>
   </property>