[FLINK-26331] Make max retries configurable

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.15.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Matthias Pohl
• Reporter: Matthias Pohl
• Created: 23/Feb/22 10:19
• Updated: 15/Mar/22 12:03
• Resolved: 28/Feb/22 16:01

Description

Right now, the retry mechanism is hard-coded to Integer.MAX_VALUE. We want to make that configurable as well and keep the default value at MAX_VALUE. This enables the user to disable the retry mechanism if necessary.

We verify how retries strategies are configured in other places and align with that to have a consistent user experience.

Issue Links

• causes: FLINK-26652 Failing to cleanup a job should not fail the Flink Cluster in Session Mode
• causes: FLINK-26359 Aligning the retry mechanism for the repeatable cleanup and task restarts
• is caused by: FLINK-25433 Integrate retry strategy for cleanup stage
• is related to: FLINK-26388 Release Testing: Repeatable Cleanup (FLINK-25433)
• links to: GitHub Pull Request #18913