[YARN-9088] Non-exclusive labels break QueueMetrics

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.8.5
• Component/s: capacity scheduler, resourcemanager
• Labels: metrics nodelabel
• Assignee: Unassigned
• Reporter: Brandon Scheller
• Created: 06/Dec/18 21:16
• Updated: 18/Feb/23 19:05

Description

QueueMetrics are broken (random/negative values) when non-exclusive labels are being used and unlabeled containers run on labeled nodes.

This is caused by the change in the patch here:

https://issues.apache.org/jira/browse/YARN-6467

It assumes that a container's label will be the same as the node's label that it is running on.

If you look within the patch, sometimes metrics are updated using the request.getNodeLabelExpression(). And sometimes they are updated using node.getPartition().

This means that in the case where the node is labeled while the container request isn't, these metrics only get updated when referring to the default queue. This stops metrics from balancing out and results in incorrect and negative values in QueueMetrics. 

Issue Links

• is caused by: YARN-6467 CSQueueMetrics needs to update the current metrics for default partition only