Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9088

Non-exclusive labels break QueueMetrics

    XMLWordPrintableJSON

Details

    Description

      QueueMetrics are broken (random/negative values) when non-exclusive labels are being used and unlabeled containers run on labeled nodes.

      This is caused by the change in the patch here:

      https://issues.apache.org/jira/browse/YARN-6467

      It assumes that a container's label will be the same as the node's label that it is running on.

      If you look within the patch, sometimes metrics are updated using the request.getNodeLabelExpression(). And sometimes they are updated using node.getPartition().

      This means that in the case where the node is labeled while the container request isn't, these metrics only get updated when referring to the default queue. This stops metrics from balancing out and results in incorrect and negative values in QueueMetrics. 

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              bdscheller Brandon Scheller
              Votes:
              2 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: