[FLINK-35130] Simplify AvailabilityNotifierImpl to support speculative scheduler and improve performance

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.20.0
• Fix Version/s: 1.20.0
• Component/s: Runtime / Network
• Labels: pull-request-available
• Assignee: Yuxin Tan
• Reporter: Yuxin Tan
• Created: 17/Apr/24 08:28
• Updated: 21/May/24 10:35
• Resolved: 21/May/24 10:35

Description

The AvailabilityNotifierImpl in SingleInputGate has maps storing the channel ids. But the map key is the result partition id, which will change according to the different attempt numbers when speculation is enabled. This can be resolved by using `inputChannels` to get channel and the map key of inputChannels will not vary with the attempts.
In addition, using that map instead can also improve performance for large scale jobs because no extra maps are created.

Issue Links

• links to: GitHub Pull Request #24674