[YARN-7473] Implement Framework and policy for capacity management of auto created queues

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.1.0
• Component/s: capacity scheduler
• Hadoop Flags: Reviewed
• Assignee: Suma Shivaprasad
• Reporter: Suma Shivaprasad
• Created: 10/Nov/17 23:35
• Updated: 08/Dec/17 23:43
• Resolved: 08/Dec/17 23:32

Description

This jira mainly addresses the following

1.Support adding pluggable policies on parent queue for dynamically managing capacity/state for leaf queues.

2. Implement a default policy that manages capacity based on pending applications and either grants guaranteed or zero capacity to queues based on parent's available guaranteed capacity.

3. Integrate with SchedulingEditPolicy framework to trigger this periodically and signal scheduler to take necessary actions for capacity/queue management.

Issue Links

• blocks: YARN-7574 Add support for Node Labels on Auto Created Leaf Queue Template