[FLINK-36424] Update deprecated YARN RM/NM callback handlers

• Type: Technical Debt
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.18.1, 1.20.0, 1.19.1
• Fix Version/s: 2.0.0
• Component/s: Deployment / YARN
• Labels: pull-request-available
• Assignee: Ferenc Csaky
• Reporter: Ferenc Csaky
• Created: 04/Oct/24 07:49
• Updated: 12/Oct/24 17:39
• Resolved: 11/Oct/24 12:38

Description

Currently the YarnResourceManagerDriver defines a callback handler class for both RM and NM [1] via a deprecated YARN interface [2].

The goal of this change to use the recommended abstract classes instead.

[1] https://github.com/apache/flink/blob/master/flink-yarn/src/main/java/org/apache/flink/yarn/YarnResourceManagerDriver.java#L658
[2] https://github.com/apache/hadoop/blame/965fd380006fa78b2315668fbc7eb432e1d8200f/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/async/AMRMClientAsync.java#L505
[3] https://github.com/apache/hadoop/blame/965fd380006fa78b2315668fbc7eb432e1d8200f/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/async/NMClientAsync.java#L461

Issue Links

• links to: GitHub Pull Request #25453