Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8384

Allow NN to startup if there are files having a lease but are not under construction

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      When there are files having a lease but are not under construction, NN will fail to start up with

      15/05/12 00:36:31 ERROR namenode.FSImage: Unable to save image for /hadoop/hdfs/namenode
      java.lang.IllegalStateException
              at com.google.common.base.Preconditions.checkState(Preconditions.java:129)
              at org.apache.hadoop.hdfs.server.namenode.LeaseManager.getINodesUnderConstruction(LeaseManager.java:412)
              at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFilesUnderConstruction(FSNamesystem.java:7124)
              ...
      

      The actually problem is that the image could be corrupted by bugs like HDFS-7587. We should have an option/conf to allow NN to start up so that the problematic files could possibly be deleted.

        Attachments

        1. HDFS-8384.000.patch
          2 kB
          Jing Zhao
        2. HDFS-8384-branch-2.6.patch
          3 kB
          Jing Zhao
        3. HDFS-8384-branch-2.7.patch
          3 kB
          Jing Zhao

        Issue Links

          Activity

            People

            • Assignee:
              jingzhao Jing Zhao
              Reporter:
              szetszwo Tsz-wo Sze

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment