[YARN-9608] DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Assignee: Abhishek Modi
• Reporter: Abhishek Modi
• Created: 06/Jun/19 11:58
• Updated: 26/May/23 05:59
• Resolved: 14/Aug/19 02:47

Description

At present, DecommissioningNodesWatcher tracks list of running applications and triggers decommission of nodes when all the applications that ran on the node completes. This Jira proposes to solve following problem:

1. DecommissioningNodesWatcher skips tracking application containers on a particular node before the node is in DECOMMISSIONING state. It only tracks containers once the node is in DECOMMISSIONING state. This can lead to shuffle data loss of apps whose containers ran on this node before it was moved to decommissioning state.
2. It is keeping track of running apps. We can leverage this directly from RMNode.

Issue Links

• is related to: YARN-11466 Graceful Decommission for Shuffle Services
• is related to: YARN-11197 Backport YARN-9608 - DecommissioningNodesWatcher should get lists of running applications on node from RMNode.