[HADOOP-5479] NameNode should not send empty block replication request to DataNode

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.19.2, 0.20.0
• Hadoop Flags: Reviewed
• Assignee: Hairong Kuang
• Reporter: Hairong Kuang
• Created: 12/Mar/09 18:02
• Updated: 07/Jan/12 14:10
• Resolved: 17/Mar/09 20:03

Description

On our production clusters, we occasionally see that NameNode sends an empty block replication request to DataNode on every heartbeat, thus blocking this DataNode from replicating or deleting any block.

This is partly caused by DataNode sending a wrong number of replications in progress which will be fixed by HADOOP-5465. There is also a flaw at the NameNode side. NameNode should not interpret the number of replications in progress as the number of targets since replication is done through a pipeline. It also should make sure that no empty replication request is sent to DataNode.

Issue Links

• is related to: HADOOP-5465 Blocks remain under-replicated