Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-955

FSImage.saveFSImage can lose edits

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.21.0, 0.22.0
    • Fix Version/s: 0.20.3
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is a continuation of a discussion from HDFS-909. The FSImage.saveFSImage function (implementing dfsadmin -saveNamespace) can corrupt the NN storage such that all current edits are lost.

        Attachments

        1. FSStateTransition7.htm
          119 kB
          Konstantin Shvachko
        2. hdfs-955-moretests.txt
          16 kB
          Todd Lipcon
        3. hdfs-955-unittest.txt
          5 kB
          Todd Lipcon
        4. PurgeEditsBeforeImageSave.patch
          3 kB
          Konstantin Shvachko
        5. saveNamespace.patch
          41 kB
          Konstantin Shvachko
        6. saveNamespace.patch
          41 kB
          Konstantin Shvachko
        7. saveNamespace.patch
          38 kB
          Konstantin Shvachko
        8. saveNamespace.patch
          34 kB
          Konstantin Shvachko
        9. saveNamespace.txt
          33 kB
          Konstantin Shvachko
        10. saveNamespace-0.20.patch
          37 kB
          Konstantin Shvachko
        11. saveNamespace-0.20.patch
          30 kB
          Konstantin Shvachko
        12. saveNamespace-0.21.patch
          41 kB
          Konstantin Shvachko
        13. saveNamespace-0.21.patch
          34 kB
          Konstantin Shvachko

        Issue Links

          Activity

            People

            • Assignee:
              shv Konstantin Shvachko
              Reporter:
              tlipcon Todd Lipcon

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment