[CAMEL-16832] camel-kafka - file descriptor leak

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.11.0
• Fix Version/s: 3.11.2, 3.12.0
• Component/s: camel-kafka
• Estimated Complexity: Unknown
• Assignee: Unassigned
• Reporter: Jens Kordowski
• Created: 02/Aug/21 10:51
• Updated: 03/Sep/21 09:54
• Resolved: 04/Aug/21 15:13

Description

The kafka consumer leaks, if the following conditions are met:

1. consumer.poll() throws an exception (i.e. TLS handshake issue)
2. PollOnError is set to RECONNECT

 

The run() method will execute another doInit(), if reconnect is set to true and the doInit() method will create another consumer. The "old" consumer does not unsubscribe and is not closed. It will hold on to 4 (I think) file descriptors, so after reiterating these reconnects many times, finally running into a "too many files" exception.

 

lr-x------ 1 root root 64 Aug 2 10:48 96 -> pipe:[19398]
l-wx------ 1 root root 64 Aug 2 10:48 97 -> pipe:[19398]
lrwx------ 1 root root 64 Aug 2 10:48 98 -> socket:[19399]
lrwx------ 1 root root 64 Aug 2 10:48 99 -> anon_inode:[eventpoll]

 

Best regards

Jens

Issue Links

• is related to: CAMEL-16857 breakOnFirstError causes thread and memory leaks in camel-kafka
• links to: GitHub Pull Request #5915
• links to: GitHub Pull Request #5925