[FLINK-2974] Add periodic offset commit to Kafka Consumer if checkpointing is disabled

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.1, 1.0.0
• Component/s: Connectors / Kafka
• Assignee: Robert Metzger
• Reporter: Robert Metzger
• Created: 05/Nov/15 10:46
• Updated: 31/Dec/15 15:31
• Resolved: 20/Nov/15 14:37

Description

Flink only writes the offsets from the consumer into ZK if checkpointing is enabled.

We should have a similar feature to Kafka's autocommit in our consumer.

Issue reported by user: http://stackoverflow.com/questions/33501574/flink-kafka-why-am-i-losing-messages