[HUDI-5090] throw runtime Exception when flink streming job checkpoint abort

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: flink
• Labels: pull-request-available
• Assignee: chenfengLiu
• Reporter: chenfengLiu
• Created: 25/Oct/22 07:41
• Updated: 15/Dec/22 06:38
• Resolved: 08/Nov/22 21:56

Description

When write task in a Flink job want to flush data, there is a condition that listened a new instant which have been start. If there is no new instant, the TM will wait for timeout.

We can see the code at https://github.com/apache/hudi/blob/master/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/common/AbstractStreamWriteFunction.java#L252.

Now there is a case that when the JM start new instant fail, JM won't retry this work. So how all the write tasks will hang.

Issue Links

• links to: GitHub Pull Request #7065