[HDFS-16331] Make dfs.blockreport.intervalMsec reconfigurable

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.5
• Fix Version/s: 3.4.0, 3.3.5
• Component/s: datanode
• Labels: pull-request-available
• Target Version/s: 3.4.0, 3.3.5
• Hadoop Flags: Reviewed
• Assignee: Tao Li
• Reporter: Tao Li
• Created: 18/Nov/21 01:36
• Updated: 11/Feb/24 04:12
• Resolved: 03/Dec/21 05:12

Description

We have a cold data cluster, which stores as EC policy. There are 24 fast disks on each node and each disk is 7 TB. 

Recently, many nodes have more than 10 million blocks, and the interval of FBR is 6h as default. Frequent FBR caused great pressure on NN.

We want to increase the interval of FBR, but have to rolling restart the DNs, this operation is very heavy. In this scenario, it is necessary to make dfs.blockreport.intervalMsec reconfigurable.

Issue Links

• links to: GitHub Pull Request #3676