[FLINK-20626] Canceling a job when it is failing will result in job hanging in CANCELING state

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.11.2, 1.12.0
• Fix Version/s: 1.11.4, 1.12.1, 1.13.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Zhu Zhu
• Reporter: Zhu Zhu
• Created: 16/Dec/20 11:50
• Updated: 17/Dec/20 07:54
• Resolved: 17/Dec/20 07:54

Description

If user manually cancels a job when the job is failing(here failing means the job encounters unrecoverable failure and is about to fail), the job will hang in CANCELING state and cannot terminate. The cause is that DefaultScheduler currently will always try to transition from `FAILING` to `FAILED` to terminate the job. However, job canceling will change job status to `CANCELING` so that the transition to `FAILED` will not success.

Issue Links

• links to: GitHub Pull Request #14405