[FLINK-33606] Support streaming mode in Flink JDBC driver

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.18.0
• Component/s: Table SQL / JDBC
• Assignee: Unassigned
• Reporter: Sangram Reddy
• Created: 21/Nov/23 11:03
• Updated: 23/Nov/23 04:40

Description

With Flink's 1.18 release we now have JDBC driver for Flink. This is a very useful addition as there are plenty of tools which can now connect to Flink and run SQL.

However, one notable difference with other JDBC drivers vs. Flink is the streaming/dynamic tables where the data is continously updated. For example, we can run an aggregate query with GROUP BY and the groups are always being updated as the fresh data arrives.

This is extremely useful for real-time monitoring applications. However, the current JDBC driver implementation only supports batch mode.

This is Jira is to add support for streaming mode for Flink JDBC driver.

 

Implementation details:

FlinkResultSet doesn't have any additional methods to expose RowKind or the unique ID for that row. However this information is already available in FlinkResultSet class, it just needs to be exposed via methods.

 

Wiki page with relevant details:

https://cwiki.apache.org/confluence/display/FLINK/FLIP-293%3A+Introduce+Flink+Jdbc+Driver+For+Sql+Gateway