[MAPREDUCE-3946] If a resource requirement is higher than available on any node, job should fail early

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.23.2, 2.0.0-alpha
• Component/s: resourcemanager
• Assignee: Unassigned
• Reporter: Todd Lipcon
• Created: 01/Mar/12 01:18
• Updated: 10/Mar/15 04:33
• Resolved: 03/May/13 23:22

Description

If you configure the NMs to have 1GB of RAM each, and then try to submit a job which has an AM resource requirement of 1.5GB, the job will neither run nor fail. Instead, it will slowly sop of all of the resources in the cluster as "reservations" despite the fact that it will never be able to schedule something. Instead, it should fail early indicating that the required memory allocation is infeasible.

Issue Links

• is duplicated by: YARN-193 Scheduler.normalizeRequest does not account for allocation requests that exceed maximumAllocation limits
• is duplicated by: YARN-56 Handle container requests that request more resources than currently available in the cluster