-
Type:
Improvement
-
Status: Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 2.8.0, 2.7.2, 2.6.3, 3.0.0-alpha1
-
Component/s: namenode
-
Labels:None
-
Hadoop Flags:Reviewed
In BlockManager, processOverReplicatedBlocksOnReCommission is called within the namespace lock. There is a (not very useful) log message printed in processOverReplicatedBlock. When there is a large number of blocks stored in a storage, printing the log message for each block can pause NN to process any other operations. We did see that it could pause NN for 30 seconds for a storage with 500k blocks.
I suggest to change the log message to trace level as a quick fix.
- relates to
-
HDFS-6425 Large postponedMisreplicatedBlocks has impact on blockReport latency
-
- Closed
-