[FLINK-29498] Flink Async I/O Retry Strategies Do Not Work for Scala AsyncDataStream API

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.15.3
• Fix Version/s: 1.17.0
• Component/s: API / Scala
• Labels: pull-request-available
• Assignee: Eric Xiao
• Reporter: Eric Xiao
• Created: 03/Oct/22 19:37
• Updated: 17/Nov/22 16:08
• Resolved: 17/Nov/22 09:54

Description

We are using the async I/O to make HTTP calls and one of the features we wanted to leverage was the retries, so we pulled the newest commit: http://github.com/apache/flink/pull/19983 into our internal Flink fork.

When I try calling the function AsyncDataStream.unorderedWaitWithRetry from the scala API I with a retry strategy from the java API I get an error as unorderedWaitWithRetry expects a scala retry strategy. The problem is that retry strategies were only implemented in java and not Scala in this PR: http://github.com/apache/flink/pull/19983.

 

Here is some of the code to reproduce the error:

import org.apache.flink.streaming.api.scala.AsyncDataStream
import org.apache.flink.streaming.util.retryable.{AsyncRetryStrategies => JAsyncRetryStrategies}

val javaAsyncRetryStrategy = new JAsyncRetryStrategies.FixedDelayRetryStrategyBuilder[Int](3, 100L)
    .build()

val data = AsyncDataStream.unorderedWaitWithRetry(
  source,
  asyncOperator,
  pipelineTimeoutInMs,
  TimeUnit.MILLISECONDS,
  javaAsyncRetryStrategy
)

Issue Links

• links to: GitHub Pull Request #21077