[HDFS-17171] CONGESTION_RATIO should be configurable

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: datanode
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: farmmamba
• Reporter: farmmamba
• Created: 29/Aug/23 03:26
• Updated: 28/Jan/24 01:44
• Resolved: 08/Oct/23 02:39

Description

Currently, The valuee of DataNode#CONGESTION_RATIO is 1.5 and it is not configurable.

When the average load of a datanode in last one minute is higer than CONGESTION_RATIO * NUM_CORES, this datanode will be regard as CONGESTED. 

In most real production envs,  the default value 1.5 seems not appropriate. So ,we should change this value to be configurable.

Issue Links

• links to: GitHub Pull Request #5996