Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5982

Need to update snapshot manager when applying editlog for deleting a snapshottable directory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.3.0
    • 2.4.0
    • namenode
    • None
    • Reviewed

    Description

      Currently after deleting a snapshottable directory which does not have snapshots any more, we also remove the directory from the snapshottable directory list in SnapshotManager. This works fine when handling a delete request from user. However, when we apply the OP_DELETE editlog, FSDirectory#unprotectedDelete(String, long) is called, which does not contain the "updating snapshot manager" process. This may leave an non-existent inode id in the snapshottable directory list, and can even lead to FSImage corruption.

      Attachments

        1. HDFS-5982.001.patch
          6 kB
          Jing Zhao
        2. HDFS-5982.001.patch
          6 kB
          Jing Zhao
        3. HDFS-5982.000.patch
          5 kB
          Jing Zhao

        Activity

          People

            jingzhao Jing Zhao
            tassapola Tassapol Athiapinya
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: