Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-955

FSImage.saveFSImage can lose edits

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.21.0, 0.22.0
    • Fix Version/s: 0.20.3
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is a continuation of a discussion from HDFS-909. The FSImage.saveFSImage function (implementing dfsadmin -saveNamespace) can corrupt the NN storage such that all current edits are lost.

        Attachments

        1. hdfs-955-unittest.txt
          5 kB
          Todd Lipcon
        2. PurgeEditsBeforeImageSave.patch
          3 kB
          Konstantin Shvachko
        3. hdfs-955-moretests.txt
          16 kB
          Todd Lipcon
        4. FSStateTransition7.htm
          119 kB
          Konstantin Shvachko
        5. saveNamespace.txt
          33 kB
          Konstantin Shvachko
        6. saveNamespace.patch
          34 kB
          Konstantin Shvachko
        7. saveNamespace-0.21.patch
          34 kB
          Konstantin Shvachko
        8. saveNamespace-0.20.patch
          30 kB
          Konstantin Shvachko
        9. saveNamespace.patch
          38 kB
          Konstantin Shvachko
        10. saveNamespace.patch
          41 kB
          Konstantin Shvachko
        11. saveNamespace.patch
          41 kB
          Konstantin Shvachko
        12. saveNamespace-0.21.patch
          41 kB
          Konstantin Shvachko
        13. saveNamespace-0.20.patch
          37 kB
          Konstantin Shvachko

        Issue Links

          Activity

            People

            • Assignee:
              shv Konstantin Shvachko
              Reporter:
              tlipcon Todd Lipcon

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment