[YARN-10538] Add recommissioning nodes to the list of updated nodes returned to the AM

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.9.1, 3.1.1
• Fix Version/s: 3.4.0, 3.3.1, 3.2.3
• Component/s: resourcemanager
• Labels: pull-request-available
• Target Version/s: 3.4.0, 3.3.1, 3.2.3
• Hadoop Flags: Reviewed
• Assignee: Srinivas S T
• Reporter: Srinivas S T
• Created: 18/Dec/20 12:26
• Updated: 11/Feb/24 07:59
• Resolved: 08/Jan/21 09:19

Description

YARN-6483 introduced nodes that transitioned to DECOMMISSIONING state to the list of updated nodes returned to the AM. This allows the Spark application master to gracefully decommission its containers on the decommissioning node. But if the node were to be recommissioned, the Spark application master would not be aware of this. We propose to add recommissioned node to the list of updated nodes sent to the AM when a recommission node transition occurs.

Issue Links

• is related to: YARN-11119 Backport YARN-10538 to branch-2.10
• relates to: YARN-6483 Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM
• links to: GitHub Pull Request #2564