[FLINK-25192] Implement proper no-claim mode support

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.15.0
• Component/s: Runtime / Checkpointing, Runtime / State Backends
• Labels: pull-request-available
• Assignee: Dawid Wysakowicz
• Reporter: Dawid Wysakowicz
• Created: 06/Dec/21 13:18
• Updated: 17/Dec/21 15:18
• Resolved: 17/Dec/21 15:18

Description

In the no-claim mode should not depend on any artefacts of the initial snapshot after the restore. In order to do that we should pass a flag along with the RPC and later on with a CheckpointBarrier to notify TaskManagers about that intention. Moreover state backends should take the flag into consideration and take "full snapshots".

The flag should be passed until the first checkpoint succeeds

• RocksDB state backend should upload all files instead of reusing artefacts from the initial one

https://cwiki.apache.org/confluence/x/bIyqCw#FLIP193:Snapshotsownership-No-claimmode(defaultmode)

Issue Links

• relates to: FLINK-25256 Savepoints do not work with ExternallyInducedSources
• links to: GitHub Pull Request #18086