[FLINK-23137] State ownership: prevent private state deletion on JM

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 1.16.0
• Component/s: Runtime / State Backends
• Assignee: Unassigned
• Reporter: Roman Khachatryan
• Created: 24/Jun/21 07:43
• Updated: 15/Aug/22 14:26
• Resolved: 15/Aug/22 14:25

Description

Inject shared state IDs computed in StateAssignmentOperation (FLINK-23342) into the SharedStateRegistry and CheckpointsCleaner and ignore other states. Should only affect changelog states (both materialized and non-materialized). 

Injection into SharedStateRegistry is done in FLINK-23342 (or can be done in this ticket).

Should take "changelog.enabled" and it's possible changes into account.

Placeholder state handles should still be replaced for both private and shared state eventually - either as part of this or of a new ticket (see also FLINK-23461).
 

See https://docs.google.com/document/d/1NJJQ30P27BmUvD7oa4FChvkYxMEgjRPTVdO1dHLl_9I/edit#heading=h.uednun2snp4l for more details

Issue Links

• blocks: FLINK-23279 Enable changelog backend in tests
• is blocked by: FLINK-23342 State ownership: compute shared state on recovery
• is related to: FLINK-23251 State ownership: Support more than one retained checkpoints