[FLINK-18858] Kinesis Flink SQL Connector

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: Connectors / Kinesis, Table SQL / Ecosystem
• Labels: pull-request-available
• Assignee: Alexander Alexandrov
• Reporter: Waldemar Hummer
• Created: 08/Aug/20 12:42
• Updated: 14/Jan/21 09:26
• Resolved: 07/Nov/20 22:11

Description

Hi all,

as far as I can see in the list of connectors, we have a flink-connector-kinesis for programmatic access to Kinesis streams, but there does not yet seem to exist a Kinesis SQL connector (something like flink-sql-connector-kinesis, analogous to flink-sql-connector-kafka).

Our use case would be to enable SQL queries with direct access to Kinesis sources (and potentially sinks), to enable something like the following Flink SQL queries:

 $ bin/sql-client.sh embedded
...
Flink SQL> CREATE TABLE Orders(`user` string, amount int, rowtime TIME) WITH ('connector' = 'kinesis', ...);
...
Flink SQL> SELECT * FROM Orders ...;
...

 

I was wondering if this is something that has been considered, or is already actively being worked on? If one of you can provide some guidance, we may be able to work on a PoC implementation to add this functionality.

 

(Wasn't able to find an existing issue in the backlog - if this is a duplicate, then please let me know as well.)

Thanks!

Issue Links

• links to: GitHub Pull Request #13770
• mentioned in: Page Loading...