[HDFS-15661] The DeadNodeDetector shouldn't be shared by different DFSClients.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.1, 3.4.0
• Fix Version/s: 3.3.1, 3.4.0
• Component/s: datanode
• Target Version/s: 3.3.1, 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Jinglun
• Reporter: Jinglun
• Created: 29/Oct/20 09:29
• Updated: 11/Feb/24 13:41
• Resolved: 28/Jan/21 02:21

Description

Currently the DeadNodeDetector is a member of ClientContext. That means it is shared by many different DFSClients. When one DFSClient.close() is invoked, the DeadNodeDetecotor thread would be interrupted and impact other DFSClients.

From the original design of HDFS-13571 we could see the DeadNodeDetector is supposed to share dead nodes of many input streams from the same client. 

We should move the DeadNodeDetector as a member of DFSClient instead of ClientContext. 

Issue Links

• relates to: HDFS-13571 Deadnode detection