[YARN-9903] Support reservations continue looking for Node Labels

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.2, 2.10.1, 3.4.0, 3.3.1
• Fix Version/s: 3.2.2, 2.10.1, 3.4.0, 3.3.1
• Component/s: capacity scheduler
• Target Version/s: 3.2.2, 2.10.1, 3.4.0, 3.3.1
• Hadoop Flags: Reviewed
• Assignee: Jim Brennan
• Reporter: Tarun Parimi
• Created: 15/Oct/19 11:11
• Updated: 11/Feb/24 12:49
• Resolved: 29/Jun/20 20:12

Description

YARN-1769 brought in reservations continue looking feature which improves the several resource reservation scenarios. However, it is not handled currently when nodes have a label assigned to them. This is useful and in many cases necessary even for Node Labels. So we should look to support this for node labels also.

For example, in AbstractCSQueue.java, we have the below TODO.

// TODO, now only consider reservation cases when the node has no label 
if (this.reservationsContinueLooking && nodePartition.equals( RMNodeLabelsManager.NO_LABEL) && Resources.greaterThan( resourceCalculator, clusterResource, resourceCouldBeUnreserved, Resources.none())) {

cc sunilg

Issue Links

• relates to: YARN-10283 Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used