[CAMEL-8653] camel-kafka need to commit the last batch offset when shutdown the consumer

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.15.0, 2.15.1, 2.15.2
• Fix Version/s: 2.15.3, 2.16.0
• Component/s: camel-kafka
• Estimated Complexity: Unknown
• Assignee: Claus Ibsen
• Reporter: Willem Jiang
• Created: 17/Apr/15 01:52
• Updated: 07/Aug/15 14:51
• Resolved: 07/Aug/15 14:51

Description

Fix of CAMEL-8636 would solve the scenario of when Kafka Broker is shutdown.

Client shutdown scenario still results in un-committed offsets from the last batch.
For this situation, Offset needs to be commited just before the Customer shutdown. Meanwhile some lock mechanism needs to be built with Shutdown hook that would do the following:

• Block messages from getting consumed from kafka
• Wait for all the messages that are getting processed to be completed.
• Commit the Offset
• Shutdown the Cosumer

Issue Links

• relates to: CAMEL-8085 Add handling of offset in case of auto commit is disabled to prevent data loss