[YARN-9893] Capacity scheduler: enhance leaf-queue-template capacity / maximum-capacity setting

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: capacity scheduler
• Assignee: Manikandan R
• Reporter: Peter Bacsko
• Created: 11/Oct/19 12:58
• Updated: 04/May/21 13:01
• Resolved: 04/May/21 13:01

Description

Capacity Scheduler does not support two percentage values for leaf queue capacity and maximum-capacity settings. So, you can't do something like this:

yarn.scheduler.capacity.root.users.john.leaf-queue-template.capacity=memory-mb=50.0%, vcores=50.0%

Only a single percentage value is accepted.

This makes it nearly impossible to properly convert a similar setting from Fair Scheduler, where such a configuration is valid and accepted (<maxChildResources>).

Note: using absolute resources (yarn.scheduler.capacity.root.users.john.leaf-queue-template.capacity=memory-mb=16384, vcores=8) is addressed in YARN-10154.

Issue Links

• duplicates: YARN-9936 Support vector of capacity percentages in Capacity Scheduler configuration
• duplicates: YARN-10758 Mixed mode: Allow relative and absolute mode in the same queue hierarchy
• is duplicated by: YARN-10154 CS Dynamic Queues cannot be configured with absolute resources