[HADOOP-109] Blocks are not replicated when...

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.0
• Fix Version/s: 0.12.0
• Assignee: Konstantin Shvachko
• Reporter: Konstantin Shvachko
• Created: 29/Mar/06 12:43
• Updated: 08/Jul/09 16:41
• Resolved: 28/Feb/07 20:18

Description

When the block is under-replicated the namenode places it into
FSNamesystem.neededReplications list.
When a datanode D1 sends getBlockwork() request to the namenode, the namenode
selects another node D2 (which it thinks is up and running) where the new replica of the
under-replicated block will be stored.
Then namenode removes the block from the neededReplications list and places it to
the pendingReplications list, and then asks D1 to replicate the block to D2.
If D2 is in fact down, then replication will fail and will never be retried later, because
the block is not in the neededReplications list, but rather in the pendingReplications list,
which namenode never checks.

Issue Links

• is part of: HADOOP-940 pendingReplications of FSNamesystem is not informative