[FLINK-12612] Track stored partitions on the TM

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: Runtime / Coordination, Runtime / Network
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 24/May/19 08:09
• Updated: 26/Jun/19 09:35
• Resolved: 26/Jun/19 09:35

Description

The TaskExecutor has to track which partitions it has stored, grouped by JobID.

This is necessary so that the TaskExecutor only disconnects from the JobManager if it no longer stores relevant (i.e., belonging to the corresponding job) partitions (similar to the taskSlotTable).

Additionally this is needed so that the TaskExecutor can independently cleanup partitions for a given job if the connection to the corresponding JobManager is lost.

Issue Links

• links to: GitHub Pull Request #8687