[HDFS-11401] Reduce verbosity of logs with favored nodes and block pinning enabled

• Type: Improvement
• Status: Patch Available
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.8.0
• Component/s: balancer & mover, datanode
• Assignee: Weiwei Yang
• Reporter: Thiruvel Thirumoolan
• Created: 09/Feb/17 19:15
• Updated: 17/Feb/17 08:44

Description

I am working on enabling favored nodes for HBase (HBASE-15531). Was trying out what happens if favored nodes is used and HDFS balancer is enabled. Ran the unit test TestBalancer#testBalancerWithPinnedBlocks from branch-2.8. There were too many exceptions and error messages with this (output attached) since pinned blocks can't be moved.

Is there any way to reduce this logging since block pinning is intentional? On a real cluster, this could be too much. HDFS-6133 enabled block pinning.

Issue Links

• relates to: HDFS-6133 Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover.