[YARN-10524] Support multi resource type based weight mode in CS.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Qi Zhu
• Reporter: Qi Zhu
• Created: 09/Dec/20 12:44
• Updated: 21/May/21 08:51
• Resolved: 21/May/21 08:51

Description

In fair scheduler support multi resource based absolute and pecentage of the cluster. 

For minResources, maxResources, maxContainerAllocation and maxChildResources properties one can give the parameter in one of the following formats:

• Old format: “X mb, Y vcores”, “X% cpu, Y% memory”, “X%”. When not a single percentage is provided, configuring both memory and cpu is mandatory, while other resource types are ignored, and set to zero.

• New format (recommended): “vcores=X, memory-mb=Y” or “vcores=X%, memory-mb=Y%”. As seen, in this format one can give either a percentage or an integer resource value without units. In the latter case the units will be inferred from the default units configured for that resource. This format is required when resources other than memory and CPU are specified. Any unspecified resource will be set to 0 in case of minResources, or to the maximum for that resource in case of maxResources, maxContainerAllocation and maxChildResources.

We should to discuss how to do in CapacityScheduler ?