[FLINK-32700] Support job drain for Savepoint upgrade mode jobs in Flink Operator

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: kubernetes-operator-1.5.0
• Fix Version/s: kubernetes-operator-1.7.0
• Component/s: Kubernetes Operator
• Labels: pull-request-available
• Assignee: Manan Mangal
• Reporter: Manan Mangal
• Created: 27/Jul/23 06:46
• Updated: 31/Aug/23 08:53
• Resolved: 31/Aug/23 08:53

Description

During cancel job with savepoint upgrade mode, jobs can be allowed to drain by advancing the watermark to the end, before they are stopped, so that the in-flight data is not lost. 

If the job fails to drain and hits timeout or any other error, it can be cancelled without taking a savepoint.

Issue Links

• links to: GitHub Pull Request #648
• links to: GitHub Pull Request #661