[YARN-10364] Absolute Resource [memory=0] is considered as Percentage config type

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: capacity scheduler
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Bilwa S T
• Reporter: Prabhu Joseph
• Created: 23/Jul/20 10:22
• Updated: 11/Feb/24 12:58
• Resolved: 08/Aug/20 17:10

Description

Absolute Resource [memory=0] is considered as Percentage config type. This causes failure while converting queues from Percentage to Absolute Resources automatically.

Repro:

1. Queue A = 100% and child queues Queue A.B = 0%, A.C=100%

2. While converting above to absolute resource automatically, capacity of queue A = [memory=<cluster resource>], A.B = [memory=0]

This fails with below as A is considered as Absolute Resource whereas B is considered as Percentage config type.

2020-07-23 09:36:40,499 WARN org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices: CapacityScheduler configuration validation failed:java.io.IOException: Failed to re-init queues : Parent queue 'root.A' and child queue 'root.A.B' should use either percentage based capacityconfiguration or absolute resource together for label: