[HDFS-16735] Reduce the number of HeartbeatManager loops

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: datanode, namenode
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Shuyan Zhang
• Reporter: Shuyan Zhang
• Created: 21/Aug/22 07:58
• Updated: 16/Oct/24 18:29
• Resolved: 29/Aug/22 04:04

Description

HeartbeatManager only processes one dead datanode (and failed storage) per round in heartbeatCheck(), that is to say, if there are ten failed storages, all datanode states need to be scanned 10 times, which is unnecessary and a waste of resources. This patch makes the number of bad storages processed per scan configurable.

Issue Links

• links to: GitHub Pull Request #4780