[FLINK-32895] Introduce the max attempts for Exponential Delay Restart Strategy

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.19.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Rui Fan
• Reporter: Rui Fan
• Created: 19/Aug/23 04:23
• Updated: 17/Dec/23 10:38
• Resolved: 15/Dec/23 04:50

Description

Currently, Flink has 3 restart strategies, they are: fixed-delay, failure-rate and exponential-delay.

The exponential-delay is suitable if a job continues to fail for a period of time. The fixed-delay and failure-rate has the max attempts mechanism, that means, the job won't restart and go to fail after the attempt exceeds the threshold of max attempts.

The max attempts mechanism is reasonable, flink should not or need to infinitely restart the job if the job keeps failing. However, the exponential-delay doesn't have the max attempts mechanism.

I propose introducing the `restart-strategy.exponential-delay.max-attempts-before-reset` to support the max attempts mechanism for exponential-delay. It means flink won't restart job if the number of job failures before reset exceeds max-attempts-before-reset when is exponential-delay is enabled.

Issue Links

• causes: FLINK-33865 exponential-delay.attempts-before-reset-backoff doesn't work when it's set in Job Configuration
• links to: GitHub Pull Request #23247