[FLINK-12193] Send TM "can be released status" with RM heartbeat

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Runtime / Coordination
• Labels: auto-deprioritized-major auto-deprioritized-minor starter
• Assignee: Unassigned
• Reporter: Andrey Zagrebin
• Created: 15/Apr/19 08:34
• Updated: 01/Dec/21 10:43

Description

We introduced a conditional release of Task Executor in Resource Manager in FLINK-10941. At the moment RM directly asks TE every release timeout whether it can be released (all depending consumers are done). We can piggyback TE/RM heartbeats for this purpose. In this case, we do not need additional RPC call to TE gateway and could potentially release TE quicker.

Issue Links

• is related to: FLINK-10941 Slots prematurely released which still contain unconsumed data