[HDFS-16371] Exclude slow disks when choosing volume

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.5
• Fix Version/s: 3.4.0, 3.3.5
• Component/s: datanode
• Labels: pull-request-available
• Hadoop Flags: Reviewed
• Assignee: Tao Li
• Reporter: Tao Li
• Created: 04/Dec/21 03:42
• Updated: 11/Feb/24 04:13
• Resolved: 06/Jan/22 00:35

Description

Currently, the datanode can detect slow disks. See HDFS-11461.

And after HDFS-16311, the slow disk information we collected is more accurate.

So we can exclude these slow disks according to some rules when choosing volume. This will prevents some slow disks from affecting the throughput of the whole datanode.

Issue Links

• links to: GitHub Pull Request #3753
• links to: GitHub Pull Request #4031