[FLINK-33991] Custom Error Handling for Kinesis Polling Consumer

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: aws-connector-4.4.0
• Component/s: Connectors / Kinesis
• Assignee: Emre Kartoglu
• Reporter: Emre Kartoglu
• Created: 04/Jan/24 13:36
• Updated: 16/Apr/24 10:33

Description

We introduced custom error handling for the Kinesis EFO Consumer as part of https://issues.apache.org/jira/browse/FLINK-33260

PR for the EFO consumer: https://github.com/apache/flink-connector-aws/pull/110

 

This ticket is to apply the same logic to the Kinesis Polling Consumer in the same codebase.

Current configuration for the EFO consumer looks like:

flink.shard.consumer.error.recoverable[0].exception=java.net.UnknownHostException
flink.shard.consumer.error.recoverable[1].exception=java.net.SocketTimeoutException 

We should re-use the same code for the polling consumer.

Issue Links

• relates to: FLINK-33260 Custom Error Handling for Kinesis EFO Consumer