[HDFS-15177] Split datanode invalide block deletion, to avoid the FsDatasetImpl lock too much time.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: datanode
• Assignee: Qi Zhu
• Reporter: Qi Zhu
• Created: 18/Feb/20 06:27
• Updated: 21/Feb/20 03:42

Description

In our cluster, the datanode receive the delete command with too many blocks deletion when we have many blockpools sharing the same datanode and the datanode with about 30 storage dirs, it will cause the FsDatasetImpl lock too much time.

 

Issue Links

• is related to: HDFS-15180 DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.