[FLINK-26286] The KubernetesStateHandleStore cleans the metadata before cleaning the StateHandle

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.15.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: David Morávek
• Reporter: Matthias Pohl
• Created: 21/Feb/22 16:14
• Updated: 02/Mar/22 13:49
• Resolved: 02/Mar/22 13:49

Description

Cleanup of job state does not work properly in an HA setup. releaseAndTryRemove deletes the meta data stored in the store before cleaning up the StateHandle. If the StateHandle cleanup fails after the reference is already deleted in the StateHandleStore, a cleanup retry will constantly fail because it cannot deserialize the StateHandle anymore.

Issue Links

• is a clone of: FLINK-26284 The ZooKeeperStateHandleStore cleans the metadata before cleaning the StateHandle
• is caused by: FLINK-25432 Introduce common interfaces for cleaning up local and global job data
• links to: GitHub Pull Request #18890
• links to: GitHub Pull Request #18901