Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-10944

camel-kafka - When consumer stop it should auto commit

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.19.0
    • camel-kafka
    • None
    • Unknown

    Description

      When you do a graceful stop of a Kafka route you should be able to auto commit so the offset is up to date on the broker, so any new consumer that failover, or if you start the route again, it will pickup from the right spot. Otherwise you have duplicates.

      The kafka consumer will auto commit in the background every 5th sec but if we dont explicit auto commit on stop then we only have the last offset from the last background thread run and therefore have much higher chances of duplicates.

      We should add option so users can control if auto commit on stop is sync,async,none

      We should do sync so its forced in case its the JVM shutting down and we cant do async in the background. And ppl can set it to none if they want as it is today

      Attachments

        Issue Links

          Activity

            People

              davsclaus Claus Ibsen
              davsclaus Claus Ibsen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: