[FLINK-26614] Upsert Kafka SQL Connector:Support startup mode of timestamp and specific offsets

• Type: New Feature
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.14.4
• Component/s: Connectors / Kafka
• Labels: auto-deprioritized-major auto-deprioritized-minor pull-request-available
• Assignee: Unassigned
• Reporter: Ning Ma
• Created: 11/Mar/22 14:37
• Updated: 11/Oct/23 18:55

Description

When we run Flink SQL using upsert-kafka connector, it cannot support startup mode of timestamp or specific offsets. It is determined to read data from the earliest.

I don't think it's reasonable. Because the data stored in Kafka is incomplete that it only saves data for 7 days in most cases. So why don't we consume data from the specified timestamp or offsets, and this can improve the efficiency of reading data from Kafka.

Issue Links

• links to: GitHub Pull Request #19067