[YARN-10503] Support queue capacity in terms of absolute resources with custom resourceType.

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.1
• Fix Version/s: 3.4.0, 3.3.1, 3.2.4
• Component/s: gpu
• Labels: pull-request-available
• Target Version/s: 3.4.0, 3.3.1
• Assignee: Qi Zhu
• Reporter: Qi Zhu
• Created: 28/Nov/20 16:00
• Updated: 27/Jan/24 00:30
• Resolved: 09/Apr/21 17:52

Description

Now the absolute resources are memory and cores.

/**
 * Different resource types supported.
 */
public enum AbsoluteResourceType {
  MEMORY, VCORES;
}

But in our GPU production clusters, we need to support more resourceTypes.

It's very import for cluster scaling when with different resourceType absolute demands.

 

This Jira will handle GPU first.

Issue Links

• is part of: YARN-5881 [Umbrella] Enable configuration of queue capacity in terms of absolute resources
• is required by: YARN-11014 YARN incorrectly validates maximum capacity resources on the validation API
• links to: GitHub Pull Request #3814