Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
Reviewed
Description
In BlockManager, processOverReplicatedBlocksOnReCommission is called within the namespace lock. There is a (not very useful) log message printed in processOverReplicatedBlock. When there is a large number of blocks stored in a storage, printing the log message for each block can pause NN to process any other operations. We did see that it could pause NN for 30 seconds for a storage with 500k blocks.
I suggest to change the log message to trace level as a quick fix.
Attachments
Attachments
Issue Links
- relates to
-
HDFS-6425 Large postponedMisreplicatedBlocks has impact on blockReport latency
- Closed