Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-988

saveNamespace race can corrupt the edits log

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20-append, 0.21.0, 0.22.0
    • Fix Version/s: 0.20-append, 0.20.205.0, 0.22.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      hbase

      Description

      The adminstrator puts the namenode is safemode and then issues the savenamespace command. This can corrupt the edits log. The problem is that when the NN enters safemode, there could still be pending logSycs occuring from other threads. Now, the saveNamespace command, when executed, would save a edits log with partial writes. I have seen this happen on 0.20.

      https://issues.apache.org/jira/browse/HDFS-909?focusedCommentId=12828853&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12828853

        Attachments

        1. 988-fixups.txt
          6 kB
          Todd Lipcon
        2. HDFS-988_fix_synchs.patch
          3 kB
          Matt Foley
        3. HDFS-988.20-security.patch
          10 kB
          Jitendra Nath Pandey
        4. hdfs-988.txt
          25 kB
          Todd Lipcon
        5. hdfs-988-2.patch
          34 kB
          Eli Collins
        6. hdfs-988-3.patch
          36 kB
          Eli Collins
        7. hdfs-988-4.patch
          50 kB
          Eli Collins
        8. hdfs-988-5.patch
          141 kB
          Eli Collins
        9. hdfs-988-6.patch
          177 kB
          Eli Collins
        10. hdfs-988-7.patch
          183 kB
          Eli Collins
        11. hdfs-988-b22-1.patch
          20 kB
          Eli Collins
        12. saveNamespace_20-append.patch
          9 kB
          Nicolas Spiegelberg
        13. saveNamespace.txt
          9 kB
          dhruba borthakur

          Issue Links

            Activity

              People

              • Assignee:
                eli Eli Collins
                Reporter:
                dhruba dhruba borthakur
              • Votes:
                0 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: