[HDFS-8384] Allow NN to startup if there are files having a lease but are not under construction

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.6.1, 2.8.0, 2.7.2, 3.0.0-alpha1
• Component/s: namenode
• Labels: 2.6.1-candidate
• Hadoop Flags: Reviewed
• Assignee: Jing Zhao
• Reporter: Tsz-wo Sze
• Created: 13/May/15 01:42
• Updated: 06/Jan/17 01:53
• Resolved: 08/Sep/15 17:55

Description

When there are files having a lease but are not under construction, NN will fail to start up with

15/05/12 00:36:31 ERROR namenode.FSImage: Unable to save image for /hadoop/hdfs/namenode
java.lang.IllegalStateException
        at com.google.common.base.Preconditions.checkState(Preconditions.java:129)
        at org.apache.hadoop.hdfs.server.namenode.LeaseManager.getINodesUnderConstruction(LeaseManager.java:412)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFilesUnderConstruction(FSNamesystem.java:7124)
        ...

The actually problem is that the image could be corrupted by bugs like HDFS-7587. We should have an option/conf to allow NN to start up so that the problematic files could possibly be deleted.

Issue Links

• relates to: HDFS-8877 Allow bypassing some minor exceptions while loading editlog