[HADOOP-11802] DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.0
• Fix Version/s: 2.6.1, 2.8.0, 2.7.1, 3.0.0-alpha1
• Labels: 2.6.1-candidate
• Target Version/s: 2.7.1
• Assignee: Colin McCabe
• Reporter: Eric Payne
• Created: 03/Apr/15 16:33
• Updated: 14/Oct/19 15:37
• Resolved: 24/Apr/15 02:10

Description

In DataXceiver#requestShortCircuitShm, we attempt to recover from some errors by closing the DomainSocket. However, this violates the invariant that the domain socket should never be closed when it is being managed by the DomainSocketWatcher. Instead, we should call shutdown on the DomainSocket. When this bug hits, it terminates the DomainSocketWatcher thread.

Issue Links

• is duplicated by: HDFS-10322 DomainSocket error lead to more and more DataNode thread waiting
• relates to: HDFS-7915 The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error