Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8384

Allow NN to startup if there are files having a lease but are not under construction

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      When there are files having a lease but are not under construction, NN will fail to start up with

      15/05/12 00:36:31 ERROR namenode.FSImage: Unable to save image for /hadoop/hdfs/namenode
      java.lang.IllegalStateException
              at com.google.common.base.Preconditions.checkState(Preconditions.java:129)
              at org.apache.hadoop.hdfs.server.namenode.LeaseManager.getINodesUnderConstruction(LeaseManager.java:412)
              at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFilesUnderConstruction(FSNamesystem.java:7124)
              ...
      

      The actually problem is that the image could be corrupted by bugs like HDFS-7587. We should have an option/conf to allow NN to start up so that the problematic files could possibly be deleted.

      Attachments

        1. HDFS-8384-branch-2.7.patch
          3 kB
          Jing Zhao
        2. HDFS-8384-branch-2.6.patch
          3 kB
          Jing Zhao
        3. HDFS-8384.000.patch
          2 kB
          Jing Zhao

        Issue Links

          Activity

            People

              jingzhao Jing Zhao
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: