I think we should keep this JIRA instead of merging it into
They try to address different new features:
FLINK-4280 is for more flexible start position configuration independent from Kafka offsets.
This JIRA is for opt-out from offset committing on Flink's checkpoints.
I'll move the respective proposed API for commit opt-out here:
Properties props = new Properties();
FlinkKafkaConsumer09 kafka = new FlinkKafkaConsumer09("topic", schema, props);
So the scenarios breaks down into:
1. props.put("auto.commit.enable", "true") & setEnableOffsetCommittingOnCheckpoints(false):
Perform auto periodic committing with the internal client (or in 0.8 case our own periodic committer), regardless of whether or not Flink checkpointing is on. Usage documentation should state clearly that if using Kafka's auto periodic committing, the offsets in Kafka will not be in-sync with the checkpoint offsets.
2. props.put("auto.commit.enable", "true") & setEnableOffsetCommittingOnCheckpoints(true):
Overrides whatever value in props for "auto.commit.enable", only commit on checkpoints. If checkpointing isn't enabled, setEnableOffsetCommittingOnCheckpoints will have no effect, and the value set for auto.commit.enable will be used instead.
3. props.put("auto.commit.enable", "false") & setEnableOffsetCommittingOnCheckpoints(false): No offset committing at all.