[CAMEL-18024] camel-kafka: rework last processed offset tracking

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.17.0
• Component/s: camel-kafka
• Estimated Complexity: Unknown
• Assignee: Otavio Rodolfo Piske
• Reporter: Otavio Rodolfo Piske
• Created: 28/Apr/22 05:16
• Updated: 21/May/22 08:01
• Resolved: 29/Apr/22 10:20

Description

The record fetcher keeps track of the last processed offset via HashMap that associates the partition+key pair to an offset. This is primarily used for rollbacks and commits when doing manual commit management.

We should probably move this within the commit management code to further simplify the code.

 

Also, as pointed here, the data structure in use is not thread-safe.

Issue Links

• is related to: CAMEL-18019 camel-kafka: review fields for concurrent access
• links to: GitHub Pull Request #7518