[HDFS-6965] NN continues to issue block locations for DNs with full disks

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha, 3.0.0-alpha1
• Fix Version/s: 2.6.0
• Component/s: namenode
• Target Version/s: 2.6.0
• Hadoop Flags: Reviewed
• Assignee: Rushabh Shah
• Reporter: Daryn Sharp
• Created: 28/Aug/14 17:42
• Updated: 12/May/16 18:14
• Resolved: 16/Sep/14 14:08

Description

Encountered issues where DNs have less space than a full block and reject incoming transfers. The NN continues giving out locations for these nodes for some period of time. It does not appear to be related to the DN's cached disk usage.

One impact is required replications are delayed when a full DN is chosen for the pipeline. A DN cannot report a broken pipeline so the replication must timeout (5m) before new targets are chosen.