[FLINK-26056] CLONE - [FLIP-171] KDS implementation of Async Sink Table API

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Assignee: Ahmed Hamdy
• Reporter: Ahmed Hamdy
• Created: 09/Feb/22 13:59
• Updated: 14/Feb/22 13:12
• Resolved: 14/Feb/22 13:12

Description

Motivation

User stories:
As a Flink user, I’d like to use the Table API for the new Kinesis Data Streams  sink.

Scope:

• Introduce AsyncDynamicTableSink that enables Sinking Tables into Async Implementations.
• Implement a new KinesisDynamicTableSink that uses KinesisDataStreamSink Async Implementation and implements AsyncDynamicTableSink.
• The implementation introduces Async Sink configurations as optional options in the table definition, with default values derived from the KinesisDataStream default values.
• Unit/Integration testing. modify KinesisTableAPI tests for the new implementation, add unit tests for AsyncDynamicTableSink and KinesisDynamicTableSink and KinesisDynamicTableSinkFactory.
• Java / code-level docs.

References

More details to be found https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink

 

Issue Links

• duplicates: FLINK-25610 [FLIP-171] Kinesis Firehose implementation of Async Sink Table API
• is a clone of: FLINK-24905 [FLIP-171] KDS implementation of Async Sink Table API

Sub-Tasks

• CLONE - [FLIP-171] Add SQL Client Uber jar for KinesisDataStreams Sink.: Closed