[YARN-7117] [Umbrella] Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue Mapping

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: capacity scheduler
• Assignee: Suma Shivaprasad
• Reporter: Wangda Tan
• Created: 29/Aug/17 00:13
• Updated: 06/Apr/18 18:40

Description

Currently Capacity Scheduler doesn't support auto creation of queues when doing queue mapping. We saw more and more use cases which has complex queue mapping policies configured to handle application to queues mapping.

The most common use case of CapacityScheduler queue mapping is to create one queue for each user/group. However update capacity-scheduler.xml and RMAdmin:refreshQueues needs to be done when new user/group onboard. One of the option to solve the problem is automatically create queues when new user/group arrives.

Sub-Tasks

• Queue Management scheduling edit policy class needs to be configured dynamically: Patch Available
• Yarn UI2 : Changes to depict Auto Created leaf Queues/Managed Queues differently from other queues: Open