[HDFS-8404] Pending block replication can get stuck using older genstamp

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.0, 2.7.0
• Fix Version/s: 2.6.1, 2.8.0, 2.7.1, 3.0.0-alpha1
• Component/s: namenode
• Labels: 2.6.1-candidate
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed
• Assignee: Nathan Roberts
• Reporter: Nathan Roberts
• Created: 14/May/15 21:43
• Updated: 06/Jan/17 01:32
• Resolved: 19/May/15 18:18

Description

If an under-replicated block gets into the pending-replication list, but later the genstamp of that block ends up being newer than the one originally submitted for replication, the block will fail replication until the NN is restarted.

It will be safer if processPendingReplications() gets up-to-date blockinfo before resubmitting replication work.