[FLINK-35992] NettyShuffleMaster not close tiered-storage resources

• Type: Bug
• Status: Resolved
• Priority: Not a Priority
• Resolution: Done
• Affects Version/s: 2.0.0, 1.20.0
• Fix Version/s: 2.0-preview
• Component/s: Runtime / Network
• Labels: pull-request-available
• Assignee: xuhuang
• Reporter: xuhuang
• Created: 07/Aug/24 06:20
• Updated: 02/Sep/24 09:35
• Resolved: 09/Aug/24 07:24

Description

When Flink's tiered storage is enabled, the NettyShuffleMaster does not close the
TieredStorageMasterClient.
This is releated to FLIP-459, which support Flink hybrid shuffle integration with Apache Celeborn.

As a result, some threads and memory resources may remain open after the flink job  is completed.

Issue Links

• links to: GitHub Pull Request #25164