[HDFS-16348] Mark slownode as badnode to recover pipeline

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: datanode
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Janus Chow
• Reporter: Janus Chow
• Created: 22/Nov/21 14:47
• Updated: 11/Feb/24 10:10
• Resolved: 29/Dec/21 15:28

Description

In HDFS-16320, the DataNode can retrieve the SLOW status from each NameNode. 

This ticket is to send this information back to Clients who are writing blocks. If a Clients noticed the pipeline is build on a slownode, he/she can choose to mark the slownode as a badnode to exclude the node or rebuild a pipeline.

In order to avoid the false positives, we added a config of "threshold", only clients continuously receives slownode reply from the same node will the node be marked as SLOW.

Issue Links

• is related to: HDFS-16320 Datanode retrieve slownode information from NameNode
• links to: GitHub Pull Request #3704