Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9088

Non-exclusive labels break QueueMetrics

    XMLWordPrintableJSON

    Details

      Description

      QueueMetrics are broken (random/negative values) when non-exclusive labels are being used and unlabeled containers run on labeled nodes.

      This is caused by the change in the patch here:

      https://issues.apache.org/jira/browse/YARN-6467

      It assumes that a container's label will be the same as the node's label that it is running on.

      If you look within the patch, sometimes metrics are updated using the request.getNodeLabelExpression(). And sometimes they are updated using node.getPartition().

      This means that in the case where the node is labeled while the container request isn't, these metrics only get updated when referring to the default queue. This stops metrics from balancing out and results in incorrect and negative values in QueueMetrics. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                bdscheller Brandon Scheller
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: