[FLINK-33684] Improve the retry strategy in CollectResultFetcher

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: API / DataStream
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: xiangyu feng
• Created: 29/Nov/23 06:46
• Updated: 02/Dec/23 13:24

Description

Currently  CollectResultFetcher use a fixed retry interval.

private void sleepBeforeRetry() {
    if (retryMillis <= 0) {
        return;
    }

    try {
        // TODO a more proper retry strategy?
        Thread.sleep(retryMillis);
    } catch (InterruptedException e) {
        LOG.warn("Interrupted when sleeping before a retry", e);
    }
} 

This can be improved with a RetryStrategy.

Issue Links

• is blocked by: FLINK-33702 Add IncrementalDelayRetryStrategy implementation of RetryStrategy
• is related to: FLINK-33698 Fix the backoff time calculation in ExponentialBackoffDelayRetryStrategy
• links to: GitHub Pull Request #23856