[HDFS-1982] Null pointer exception is thrown when NN restarts with a block lesser in size than the block that is present in DN1 but the generation stamp is greater in the NN

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.20-append
• Component/s: namenode

Environment

Linux

• Assignee: Unassigned
• Reporter: ramkrishna.s.vasudevan
• Created: 23/May/11 13:11
• Updated: 10/Mar/15 03:00
• Resolved: 10/Mar/15 03:00

Description

Conisder the following scenario.
WE have a cluster with one NN and 2 DN.

We write some file.

One of the block is written in DN1 but not yet completed in DN2 local disk.

Now DN1 gets killed and so pipeline recovery happens for the block with the size as in DN2 but the generation stamp gets updated in the NN.

DN2 also gets killed.

Now restart NN and DN1
Now if NN restarts, the block that NN has greater time stamp but the size is lesser in the NN.

This leads to Null pointer exception in addstoredblock api