[FLINK-24275] Allow idempotent job cancellation

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: Runtime / REST
• Labels: pull-request-available
• Release Note: Attempting to cancel a FINISHED/FAILED job now returns 409 Conflict instead of 404 Not Found.
• Assignee: Chesnay Schepler
• Reporter: Austin Cawley-Edwards
• Created: 13/Sep/21 19:53
• Updated: 07/Apr/22 13:05
• Resolved: 06/Oct/21 07:42

Description

As a user of Flink, I want to be able to cancel a job from an external system in a fault-tolerant way without guessing if the job has already been cancelled.

 

Currently, the cancel endpoint (PATCH /jobs/:jobid?mode=cancel) will return a 404 if the job is already cancelled. This makes it hard to detect if the job truly doesn't exist, or if it is already in the desired state.

Issue Links

• causes: FLINK-24472 DispatcherTest is unstable
• causes: FLINK-26045 Document error status codes for the REST API
• is duplicated by: FLINK-9389 Improve error message when cancelling job in state canceled via REST API
• links to: GitHub Pull Request #17390