[HDFS-16287] Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.2
• Fix Version/s: 3.4.0, 3.3.2
• Component/s: datanode
• Labels: pull-request-available
• Target Version/s: 3.4.0, 3.3.2
• Hadoop Flags: Reviewed
• Assignee: Haiyang Hu
• Reporter: Haiyang Hu
• Created: 27/Oct/21 09:27
• Updated: 11/Feb/24 09:52
• Resolved: 12/Nov/21 02:08

Description

1. Consider that make dfs.namenode.avoid.read.slow.datanode reconfigurable and rapid rollback in case this feature HDFS-16076 unexpected things happen in production environment

2. DatanodeManager#startSlowPeerCollector by parameter 'dfs.datanode.peer.stats.enabled' to control

Issue Links

• Dependency: HDFS-16314 Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable
• relates to: HDFS-16076 Avoid using slow DataNodes for reading by sorting locations
• links to: GitHub Pull Request #3596