[YARN-10887] Investigation: Decouple capacity and max-capacity modes

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Szilard Nemeth
• Created: 18/Aug/21 09:14
• Updated: 25/Jan/24 15:58

Description

Currently Fair Scheduler supports the following 3 kinds of settings:

• Single percentage (relative to parent) i.e. "X%"
• A set of percentages (relative to parent) i.e. "X% cpu, Y% memory"
• Absolute resources i.e. "X mb, Y vcores"

Please note, that the new, recommended format does not support the single percentage mode, only the last 2, like: “vcores=X, memory-mb=Y” or “vcores=X%, memory-mb=Y%” respectively.

It is recommended that all three formats are supported for maximum-capacity in CS after introducing weight mode.

Issue Links

• Dependent: YARN-9936 Support vector of capacity percentages in Capacity Scheduler configuration
• is related to: YARN-10505 Extend the maximum-capacity property to support Fair Scheduler migration