[FLINK-3398] Flink Kafka consumer should support auto-commit opt-outs

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: Connectors / Kafka
• Assignee: Tzu-Li (Gordon) Tai
• Reporter: Shikhar Bhushan
• Created: 15/Feb/16 03:14
• Updated: 02/Oct/19 17:45
• Resolved: 14/Mar/17 17:26

Description

Currently the Kafka source will commit consumer offsets to Zookeeper, either upon a checkpoint if checkpointing is enabled, otherwise periodically based on auto.commit.interval.ms

It should be possible to opt-out of committing consumer offsets to Zookeeper. Kafka has this config as auto.commit.enable (0.8) and enable.auto.commit (0.9).

Issue Links

• links to: GitHub Pull Request #1690
• links to: GitHub Pull Request #3527