[HDFS-7993] Provide each Replica details in fsck

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed
• Assignee: J.Andreina
• Reporter: Ming Ma
• Created: 26/Mar/15 03:04
• Updated: 30/Aug/16 01:38
• Resolved: 21/Apr/15 09:59

Description

When you run fsck with "-files" or "-racks", you will get something like below if one of the replicas is decommissioned.

blk_x len=y repl=3 [dn1, dn2, dn3, dn4]

That is because in NamenodeFsck, the repl count comes from live replicas count; while the actual nodes come from LocatedBlock which include decommissioned nodes.

Another issue in NamenodeFsck is BlockPlacementPolicy's verifyBlockPlacement verifies LocatedBlock that includes decommissioned nodes. However, it seems better to exclude the decommissioned nodes in the verification; just like how fsck excludes decommissioned nodes when it check for under replicated blocks.

Issue Links

• relates to: HDFS-8174 Update replication count to live rep count in fsck report