[FLINK-3397] Failed streaming jobs should fall back to the most recent checkpoint/savepoint

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Component/s: Runtime / State Backends
• Assignee: Unassigned
• Reporter: Gyula Fora
• Created: 14/Feb/16 20:47
• Updated: 28/Feb/19 10:45
• Resolved: 18/Aug/16 17:49

Description

The current fallback behaviour in case of a streaming job failure is slightly counterintuitive:

If a job fails it will fall back to the most recent checkpoint (if any) even if there were more recent savepoint taken. This means that savepoints are not regarded as checkpoints by the system only points from where a job can be manually restarted.

I suggest to change this so that savepoints are also regarded as checkpoints in case of a failure and they will also be used to automatically restore the streaming job.

Issue Links

• is related to: FLINK-11159 Allow configuration whether to fall back to savepoints for restore
• is superceded by: FLINK-4322 Unify CheckpointCoordinator and SavepointCoordinator
• links to: GitHub Pull Request #2195