[CAMEL-10944] camel-kafka - When consumer stop it should auto commit

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.19.0
• Component/s: camel-kafka
• Estimated Complexity: Unknown
• Assignee: Claus Ibsen
• Reporter: Claus Ibsen
• Created: 05/Mar/17 17:47
• Updated: 28/Mar/22 09:21
• Resolved: 05/Mar/17 17:50

Description

When you do a graceful stop of a Kafka route you should be able to auto commit so the offset is up to date on the broker, so any new consumer that failover, or if you start the route again, it will pickup from the right spot. Otherwise you have duplicates.

The kafka consumer will auto commit in the background every 5th sec but if we dont explicit auto commit on stop then we only have the last offset from the last background thread run and therefore have much higher chances of duplicates.

We should add option so users can control if auto commit on stop is sync,async,none

We should do sync so its forced in case its the JVM shutting down and we cant do async in the background. And ppl can set it to none if they want as it is today

Issue Links

• relates to: CAMEL-17802 Check whether we need to manually commit offset upon stop when auto commit is enabled