[YARN-11425] [Federation] Router Supports SubClusterCleaner

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: federation
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Shilun Fan
• Reporter: Shilun Fan
• Created: 25/Jan/23 08:57
• Updated: 06/Jun/23 03:10
• Resolved: 15/Feb/23 22:40

Description

In YARN-Federation mode, once a SubCluster is registered, the SubCluster is always in the RUNNING state, even if the SubCluster has no heartbeat for a long time.
We will let the Router automatically check the heartbeat time of the SubCluster, and once the heartbeat exceeds 30mins, we will set the SubCluster to the SC_LOST state.

Issue Links

• links to: GitHub Pull Request #5326
• links to: GitHub Pull Request #5712