[YARN-10394] RACK/NODE_LOCAL Request have same nodelabel as ANY Request

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.9.2
• Component/s: scheduler

Environment

//代码占位符

 private void updateNodeLabels(ResourceRequest request) {
    String resourceName = request.getResourceName();
    if (resourceName.equals(ResourceRequest.ANY)) {
      ResourceRequest previousAnyRequest =
          getResourceRequest(resourceName);      // When there is change in ANY request label expression, we should
      // update label for all resource requests already added of same
      // priority as ANY resource request.
      if ((null == previousAnyRequest) || hasRequestLabelChanged(
          previousAnyRequest, request)) {
        for (ResourceRequest r : resourceRequestMap.values()) {
          if (!r.getResourceName().equals(ResourceRequest.ANY)) {
            r.setNodeLabelExpression(request.getNodeLabelExpression());
          }
        }
      }
    } else{

      // if resource Name is not ANY its nodeLabel will be same as ANY Request
      ResourceRequest anyRequest = getResourceRequest(ResourceRequest.ANY);
      if (anyRequest != null) {
        request.setNodeLabelExpression(anyRequest.getNodeLabelExpression());
      }
    }
  }

 

 

• Target Version/s: 2.9.2
• Assignee: Unassigned
• Reporter: chan
• Created: 11/Aug/20 06:48
• Updated: 11/Aug/20 06:50

Description

LocalitySchedulingPlacementSet.updateNodeLabels make RACK/NODE_LOCAL Request have same nodelabel as ANY Request instead of <DEFAULT_PARTITION>

Issue Links

• Is contained by: MAPREDUCE-6304 Specifying node labels when submitting MR jobs