[YARN-10935] AM Total Queue Limit goes below per-user AM Limit if parent is full.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.4.0, 2.10.2, 3.3.2, 3.2.4, 3.1.5
• Component/s: capacity scheduler, capacityscheduler
• Assignee: Eric Payne
• Reporter: Eric Payne
• Created: 07/Sep/21 17:50
• Updated: 06/Sep/22 15:21
• Resolved: 23/Sep/21 17:14

Description

This happens when DRF is enabled and all of one resource is consumed but the second resources still has plenty available.

This is reproduceable by setting up a parent queue where the capacity and max capacity are the same, with 2 or more sub-queues whose max capacity is 100%.

In one of the sub-queues, start a long-running app that consumes all resources in the parent queue's hierarchy. This app will consume all of the memory but not vary many vcores (for example)

In a second queue, submit an app. The Max Application Master Resources Per User limit is much more than the Max Application Master Resources limit.