[HDFS-15709] EC: Socket file descriptor leak in StripedBlockChecksumReconstructor

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.2.2, 3.3.1, 3.4.0, 3.2.3
• Component/s: datanode, ec, erasure-coding
• Labels: pull-request-available
• Assignee: Yushi Hayasaka
• Reporter: Yushi Hayasaka
• Created: 04/Dec/20 06:41
• Updated: 08/May/22 13:06
• Resolved: 07/Dec/20 23:52

Description

We found a socket file descriptor leak when we tried to get the checksum of EC file with reconstruction happened during the operation.
The cause of the leak seems that the StripedBlockChecksumReconstructor does not close StripedReader. Making the reader closed, the CLOSE_WAIT connections are gone.

Issue Links

• relates to: HDFS-16565 DataNode holds a large number of CLOSE_WAIT connections that are not released
• links to: GitHub Pull Request #2518