Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8384

Allow NN to startup if there are files having a lease but are not under construction

    Details

    • Hadoop Flags:
      Reviewed

      Description

      When there are files having a lease but are not under construction, NN will fail to start up with

      15/05/12 00:36:31 ERROR namenode.FSImage: Unable to save image for /hadoop/hdfs/namenode
      java.lang.IllegalStateException
              at com.google.common.base.Preconditions.checkState(Preconditions.java:129)
              at org.apache.hadoop.hdfs.server.namenode.LeaseManager.getINodesUnderConstruction(LeaseManager.java:412)
              at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFilesUnderConstruction(FSNamesystem.java:7124)
              ...
      

      The actually problem is that the image could be corrupted by bugs like HDFS-7587. We should have an option/conf to allow NN to start up so that the problematic files could possibly be deleted.

        Attachments

        1. HDFS-8384-branch-2.7.patch
          3 kB
          Jing Zhao
        2. HDFS-8384-branch-2.6.patch
          3 kB
          Jing Zhao
        3. HDFS-8384.000.patch
          2 kB
          Jing Zhao

          Issue Links

            Activity

              People

              • Assignee:
                jingzhao Jing Zhao
                Reporter:
                szetszwo Tsz Wo Nicholas Sze
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: