[FLINK-25610] [FLIP-171] Kinesis Firehose implementation of Async Sink Table API

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: Connectors / Kinesis
• Labels: pull-request-available
• Assignee: Ahmed Hamdy
• Reporter: Ahmed Hamdy
• Created: 11/Jan/22 11:03
• Updated: 14/Feb/22 13:13
• Resolved: 12/Feb/22 20:13

Description

Motivation

User stories:
As a Flink user, I’d like to use the Table API for the new Kinesis Firehose async sink.

Scope:

• Add a new module for flink-connector-kinesis-data-firehose-table.
• Implement a new KinesisFirehoseDynamicTableSink that uses KinesisDataFirehoseSink Async Implementation and implements AsyncDynamicTableSink.
• The implementation introduces Async Sink configurations as optional options in the table definition, with default values derived from the KinesisDataFirehose default values.
• Unit/Integration testing. modify KinesisTableAPI tests for the new implementation, add unit tests for AsyncDynamicTableSink and KinesisDynamicTableSink and KinesisDynamicTableSinkFactory.
• Java / code-level docs.
• Add documentations for Table Api connector for Kinesis data firehose.

References

More details to be found https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink

Issue Links

• Dependent: FLINK-24041 [FLIP-171] Generic AsyncSinkBase
• is blocked by: FLINK-24228 [FLIP-171] Firehose implementation of Async Sink
• is duplicated by: FLINK-26057 CLONE - [FLIP-171] Add SQL Client Uber jar for KinesisDataStreams Sink.
• is duplicated by: FLINK-26056 CLONE - [FLIP-171] KDS implementation of Async Sink Table API
• links to: GitHub Pull Request #18603

Sub-Tasks

• Add documentation for Kinesis Firehose table API.: Resolved