[FLINK-26908] HA job cannot to restarting

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.13.3
• Component/s: Runtime / Coordination
• Assignee: Unassigned
• Reporter: WangMinChao
• Created: 29/Mar/22 07:29
• Updated: 29/Mar/22 12:46

Description

We have running a job about the flinkcdc wrtiing to starrocks.

At the first failure， this job can been restarting，and  successful create archived file .

2022-03-20 18:41:15,812 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job mysql_2_sr_sr_cluster_1_qqm (971eb686ebd6af2f45f77ba97575443c) switched from state RESTARTING to SUSPENDED.
org.apache.flink.util.FlinkException: Scheduler is being stopped. ...

...

2022-03-20 18:41:16,139 INFO org.apache.flink.runtime.history.FsJobArchivist [] - Job 971eb686ebd6af2f45f77ba97575443c has been archived at cosn://bg-rt-flink-prod-1254213275/flink/completed-jobs/971eb686ebd6af2f45f77ba97575443c. 

...

2022-03-20 18:41:15,843 INFO  org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcess [] - Start JobDispatcherLeaderProcess.  

 

On a subsequent failure，this job cannot to restarting，and not successful create archived file 

2022-03-22 16:18:44,991 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job mysql_2_sr_sr_cluster_1_qqm (971eb686ebd6af2f45f77ba97575443c) switched from state RUNNING to SUSPENDED.org.apache.flink.util.FlinkException: Scheduler is being stopped.

...

2022-03-22 16:19:00,080 ERROR org.apache.flink.runtime.history.FsJobArchivist              [] - Failed to archive job.org.apache.hadoop.fs.FileAlreadyExistsException: File already exists: cosn://bg-rt-flink-prod-1254213275/flink/completed-jobs/971eb686ebd6af2f45f77ba97575443c 

...

2022-03-22 16:19:00,919 INFO  org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcess [] - Stopping JobDispatcherLeaderProcess.