[CAMEL-16857] breakOnFirstError causes thread and memory leaks in camel-kafka

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.11.1
• Fix Version/s: 3.11.2, 3.12.0
• Component/s: camel-kafka
• Estimated Complexity: Unknown
• Assignee: Unassigned
• Reporter: Vladimir Dobos
• Created: 09/Aug/21 09:15
• Updated: 13/Mar/24 13:23
• Resolved: 03/Sep/21 10:08

Description

When breakOnfirstError is enabled in camel-kafka, there is visible thread leak (one hung heartbeat thread per kafka client restart/route retry) in underlying kafka client, accompanied by small memory leak, for extreme example - see attached VisualVM screenshots).
Example application used for screenshot can be found in https://github.com/vdobos-tr/camel-kafka-on-error-leak.
We are relatively new to kafka so im unable to determine, if its issue with underlying kafka client, or problem with the way camel handles reconnect after error.

Issue Links

• relates to: CAMEL-16832 camel-kafka - file descriptor leak
• relates to: CAMEL-20563 camel-kafka - breakOnFirstError causes thread and memory leaks