[CAMEL-19180] Kafka Idempotent Repository does not give the user control over a randomized group id if the kafka broker requires the id to be in a specified form

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.21.0, 4.0-M3, 4.0.0

Environment

https://github.com/apache/camel/blob/main/components/camel-kafka/src/main/java/org/apache/camel/processor/idempotent/kafka/KafkaIdempotentRepository.java

• Estimated Complexity: Unknown
• Assignee: Andrea Cosentino
• Reporter: Rahul Kumar
• Created: 21/Mar/23 16:07
• Updated: 05/Apr/23 09:24
• Resolved: 05/Apr/23 09:24

Description

https://github.com/apache/camel/blob/main/components/camel-kafka/src/main/java/org/apache/camel/processor/idempotent/kafka/KafkaIdempotentRepository.java

In this class above:  Line 288

String groupId = UUID.randomUUID().toString();

causes major problems for kafka brokers that expect group ids to be in a specified form. Impact is that we cannot subscribe to get the duplicate messages if the app restarts as we do not have access to all the messages that were produced to the topic for checking for duplicates. If this sort of control can be given to the user to set the group id, that would be very ideal, as I am right now copy pasting the class and adding the logic for formatting the group id for our requirement to make deduplication work on our side.

 

Please let us know if there is a way we can either bypass the logic here, or have this released in a newer version.