[FLINK-18165] When savingpoint is restored, select the checkpoint directory and stateBackend

• Type: Improvement
• Status: Closed
• Priority: Not a Priority
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Component/s: Runtime / State Backends
• Labels: auto-deprioritized-major auto-deprioritized-minor

Environment

flink 1.9

• Assignee: Unassigned
• Reporter: Xinyuan Liu
• Created: 06/Jun/20 06:46
• Updated: 08/Dec/21 07:30
• Resolved: 08/Dec/21 07:30

Description

If the checkpoint file is used as the initial state of the savepoint startup, it must be ensured that the state backend used before and after is the same type, but in actual production, there will be more and more state, the taskmanager memory is insufficient and the cluster cannot be expanded, and the state backend needs to be switched at this time. And there is a need to ensure data consistency. Unfortunately, currently flink does not provide an elegant way to switch state backend, can the community consider this proposal

Issue Links

• is fixed by: FLINK-20976 Unify binary format for Keyed State savepoints