[FLINK-24277] Offset commit should be disabled if consumer group ID is not specified in KafkaSource

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.14.0, 1.13.3, 1.12.8
• Component/s: Connectors / Kafka
• Labels: pull-request-available
• Assignee: Qingsheng Ren
• Reporter: Qingsheng Ren
• Created: 14/Sep/21 06:57
• Updated: 15/Dec/21 01:40
• Resolved: 18/Sep/21 13:54

Description

FLINK-24051 made "group.id" an optional configuration in KafkaSource. However, KafkaSource will generate a random group id if user doesn't specify one, and this random ID is inconsistent after failover, and not even human readable.

A solution will be adding a configuration for offset commit on checkpoint, make it as true by default, and disable offset commit if group id is not specified. 

Issue Links

• links to: GitHub Pull Request #17276