[FLINK-33068] Handle DNS errors in AWS connectors as recoverable

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.15.4, 1.16.2, 1.17.1
• Fix Version/s: 1.15.4, 1.16.2, 1.17.1
• Component/s: Connectors / AWS
• Assignee: Elphas Toringepi
• Reporter: Elphas Toringepi
• Created: 08/Sep/23 22:05
• Updated: 09/Oct/23 13:45

Description

AWS connectors are not treating DNS errors as recoverable using exponential back-off resulting in Flink job restarts on transient errors and small timeouts.

 

DNS errors typically manifest as UnknownHostException which is not handled as a recoverable exception and potentially not retried.

 

Here is an example of an exception that is recoverable with exponential-backoff.