[HDFS-5443] Delete 0-sized block when deleting an under-construction file that is included in snapshot

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0, 3.0.0-alpha1
• Fix Version/s: 2.3.0
• Component/s: snapshots
• Target Version/s: 2.3.0
• Hadoop Flags: Reviewed
• Assignee: Jing Zhao
• Reporter: Uma Maheswara Rao G
• Created: 29/Oct/13 18:40
• Updated: 12/May/16 18:17
• Resolved: 07/Nov/13 18:46

Description

Namenode can stuck in safemode on restart if it crashes just after addblock logsync and after taking snapshot for such file. This issue is reported by Prakash and Sathish.

On looking into the issue following things are happening.
.
1) Client added block at NN and just did logsync
So, NN has block ID persisted.
2)Before returning addblock response to client take a snapshot for root or parent directories for that file
3) Delete parent directory for that file
4) Now crash the NN with out responding success to client for that addBlock call

Now on restart of the Namenode, it will stuck in safemode.

Issue Links

• is related to: HDFS-5428 under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode
• relates to: HDFS-4516 Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever