[HBASE-11142] Taking snapshots can leave sockets on the master stuck in CLOSE_WAIT state

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 0.94.2, 0.99.0, 0.96.1.1, 0.98.2
• Assignee: Unassigned
• Reporter: Andrew Kyle Purtell
• Created: 08/May/14 23:47
• Updated: 17/Jun/22 15:54
• Resolved: 17/Jun/22 15:54

Description

As reported by Hansi Klose on user@.

we use a script to take on a regular basis snapshot's and delete old one's.
We recognizes that the web interface of the hbase master was not working any more because of too many open files.
The master reaches his number of open file limit of 32768
When I run lsof I saw that there where a lot of TCP CLOSE_WAIT handles open with the regionserver as target.
On the regionserver there is just one connection to the hbase master.
I can see that the count of the CLOSE_WAIT handles grow each time
i take a snapshot. When i delete on nothing changes.
Each time i take a snapshot there are 20 - 30 new CLOSE_WAIT handles.