[YARN-55] YARN needs to properly check the NM,AM memory properties in yarn-site.xml and mapred.xml and report errors accordingly.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.0.2-alpha, 0.23.3
• Component/s: resourcemanager
• Labels: Map Reduce YARN

Environment

CentOs6.0, Hadoop2.0.0 Alpha

• Assignee: Unassigned
• Reporter: Anil Gupta
• Created: 02/Aug/12 23:22
• Updated: 14/Apr/13 20:56
• Resolved: 14/Apr/13 20:56

Description

Please refer to this discussion on the Hadoop Mailing list:
http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/33110

Summary:
I was running YARN(Hadoop2.0.0 Alpha) on a 8 datanode, 4 admin node Hadoop/HBase cluster. My datanodes were only having 3.2GB of memory. So, i configured the yarn.nodemanager.resource.memory-mb property in yarn-site.xml to 1200. After setting the property if i run any Yarn Job then the NodemManager wont be able to start any Map task since by default the yarn.app.mapreduce.am.resource.mb property is set to 1500 MB in mapred-site.xml.
Expected Behavior: NodeManager should give an error if yarn.app.mapreduce.am.resource.mb >= yarn.nodemanager.resource.memory-mb.

Please let me know if more information is required.