[HDFS-16412] Add metrics to support obtaining file size distribution

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.4.0
• Component/s: namenode
• Assignee: Xiangyi Zhu
• Reporter: Xiangyi Zhu
• Created: 05/Jan/22 08:40
• Updated: 05/Jan/22 08:41

Description

Use RangeMapRange "Map<Long, MutableLong> fileSizeRange" to store counters at different intervals. RangeMap key is a specific interval, and value is the counter corresponding to the interval.

Counter update:
When the file size changes or the file is deleted, the file size is obtained, and the counter in the corresponding interval is called to update the counter.

Interval division:
The default is to initialize the startup according to the following interval, or it can be initialized through the configuration file.
0MB
0-16MB
16-32MB
32-64MB
64-128MB
128-256MB
256-512MB
>512MB