Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-988

saveNamespace race can corrupt the edits log

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.20-append, 0.21.0, 0.22.0
    • 0.20-append, 0.20.205.0, 0.22.0
    • namenode
    • None
    • Reviewed
    • hbase

    Description

      The adminstrator puts the namenode is safemode and then issues the savenamespace command. This can corrupt the edits log. The problem is that when the NN enters safemode, there could still be pending logSycs occuring from other threads. Now, the saveNamespace command, when executed, would save a edits log with partial writes. I have seen this happen on 0.20.

      https://issues.apache.org/jira/browse/HDFS-909?focusedCommentId=12828853&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12828853

      Attachments

        1. 988-fixups.txt
          6 kB
          Todd Lipcon
        2. HDFS-988_fix_synchs.patch
          3 kB
          Matthew Foley
        3. HDFS-988.20-security.patch
          10 kB
          Jitendra Nath Pandey
        4. hdfs-988.txt
          25 kB
          Todd Lipcon
        5. hdfs-988-2.patch
          34 kB
          Eli Collins
        6. hdfs-988-3.patch
          36 kB
          Eli Collins
        7. hdfs-988-4.patch
          50 kB
          Eli Collins
        8. hdfs-988-5.patch
          141 kB
          Eli Collins
        9. hdfs-988-6.patch
          177 kB
          Eli Collins
        10. hdfs-988-7.patch
          183 kB
          Eli Collins
        11. hdfs-988-b22-1.patch
          20 kB
          Eli Collins
        12. saveNamespace_20-append.patch
          9 kB
          Nicolas Spiegelberg
        13. saveNamespace.txt
          9 kB
          Dhruba Borthakur

        Issue Links

          Activity

            People

              eli Eli Collins
              dhruba Dhruba Borthakur
              Votes:
              0 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: