[YARN-10886] Cluster based and parent based max capacity in Capacity Scheduler

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Szilard Nemeth
• Created: 18/Aug/21 09:11
• Updated: 25/Jan/24 15:56

Description

We want to introduce the percentage modes relative to the cluster, not the parent, i.e
The property root.users.maximum-capacity will mean one of the following things:

Either Parent Percentage: maximum capacity relative to its parent. If it’s set to 50, then it means that the capacity is capped with respect to the parent. This can be covered by the current format, no change there.
Or Cluster Percentage: maximum capacity expressed as a percentage of the overall cluster capacity. This case is the new scenario, for example:
yarn.scheduler.capacity.root.users.max-capacity = c:50%
yarn.scheduler.capacity.root.users.max-capacity = c:50%, c:30%

Issue Links

• is related to: YARN-10505 Extend the maximum-capacity property to support Fair Scheduler migration