[CAMEL-18135] camel-kafka: async manual commit is using sync commits and is broken

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.17.0
• Fix Version/s: 3.18.0
• Component/s: camel-kafka
• Estimated Complexity: Unknown
• Assignee: Otavio Rodolfo Piske
• Reporter: Otavio Rodolfo Piske
• Created: 21/May/22 07:57
• Updated: 21/May/22 12:44
• Resolved: 21/May/22 12:44

Description

Quoting from this comment: https://github.com/apache/camel/pull/7518#issuecomment-1133016320

 

@orpiske the async commit process seems to be broken. The commit() function in DefaultKafkaManualAsyncCommit calls a forceCommit() function which is synchronous.
And when fixing it using the commit() function (async with the manager), the test throw a ConcurrentModificationException().
We need to reintroduce a ConcurrentQueue storing commits which should be process by the main kafka consumer polling loop and thread.

Issue Links

• links to: GitHub Pull Request #7664