[HDFS-5020] Make DatanodeProtocol#blockReceivedAndDeleted idempotent

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha1
• Fix Version/s: 2.1.0-beta
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Jing Zhao
• Reporter: Jing Zhao
• Created: 22/Jul/13 23:46
• Updated: 12/May/16 18:13
• Resolved: 24/Jul/13 07:37

Description

Currently DatanodeProtocol#blockReceivedAndDeleted is not idempotent because pending replication maps in NN only tracks the number of the pending replicas, and a retry request about a received block can cause the pending number decreased more than once. We can make blockReceivedAndDeleted idempotent by tracking corresponding datanodes in the pending replication map.