[FLINK-8777] improve resource release when recovery from failover

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.0
• Component/s: Runtime / State Backends
• Assignee: Sihua Zhou
• Reporter: Sihua Zhou
• Created: 26/Feb/18 10:27
• Updated: 28/Feb/18 12:37
• Resolved: 28/Feb/18 12:37

Description

When recovery from failed, TaskLocalStateStoreImpl.retrieveLocalState() will be invoked, we can release all entry from storedTaskStateByCheckpointID that does not satisfy entry.checkpointID == checkpointID, this can prevent the resource leak when job loop in local checkpoint completed => failed => local checkpoint completed => failed ....

Issue Links

• links to: GitHub Pull Request #5578