[YARN-10687] Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.2, 3.4.0
• Fix Version/s: 3.4.0, 3.3.1, 3.2.3
• Component/s: nodemanager
• Assignee: Qi Zhu
• Reporter: Qi Zhu
• Created: 11/Mar/21 05:53
• Updated: 10/Jun/21 08:15
• Resolved: 12/Mar/21 17:58

Description

Now the two option:

max-disk-utilization-per-disk-percentage
min-free-space-per-disk-mb

for full/not full disk check are all enabled always, i think it's more reasonable to enable or disable this, and default will be all enabled.

 

In our clusters, when the disk is so huge we want to use  min-free-space-per-disk-mb.

In our clusters,  when the disk is so small we want to use max-disk-utilization-per-disk-percentage.

 

We should make this more reasonable and not confused.

 

cc pbacsko  Jim_Brennan  ebadger  gandras