[AVRO-3165] [avro-ipc-netty] NioEventLoopGroup leak in NettyTransceiver

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.10.0, 1.10.1, 1.10.2
• Fix Version/s: 1.11.0
• Component/s: java
• Labels: ipc netty
• Assignee: Benjamin Leber
• Reporter: Benjamin Leber
• Created: 30/Jun/21 05:57
• Updated: 29/May/24 19:28
• Resolved: 30/Jun/21 15:32

Description

The NettyTransceiver is used on server and client side. While it requires a worker group on client side this is not necessary on server side.

But as the worker group is initialized during the variable declaration. It is also created on the server for every new connection, but it gets never closed. This causes high off heap memory and always increasing open file descriptors.

Moving the creation of the workger group into the constructor which is called on client side, solves the problem (deployed after the second 12:00 in above graph)

I will provide a pr to fix.

Issue Links

• causes: HDDS-10882 [Hbase-Ozone] Regionservers down with "newSocketStream(..) failed: Too many open files"
• links to: GitHub Pull Request #1274