Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-988

saveNamespace race can corrupt the edits log

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20-append, 0.21.0, 0.22.0
    • Fix Version/s: 0.20-append, 0.20.205.0, 0.22.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      hbase

      Description

      The adminstrator puts the namenode is safemode and then issues the savenamespace command. This can corrupt the edits log. The problem is that when the NN enters safemode, there could still be pending logSycs occuring from other threads. Now, the saveNamespace command, when executed, would save a edits log with partial writes. I have seen this happen on 0.20.

      https://issues.apache.org/jira/browse/HDFS-909?focusedCommentId=12828853&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12828853

      1. saveNamespace.txt
        9 kB
        dhruba borthakur
      2. saveNamespace_20-append.patch
        9 kB
        Nicolas Spiegelberg
      3. hdfs-988-b22-1.patch
        20 kB
        Eli Collins
      4. hdfs-988-7.patch
        183 kB
        Eli Collins
      5. hdfs-988-6.patch
        177 kB
        Eli Collins
      6. hdfs-988-5.patch
        141 kB
        Eli Collins
      7. hdfs-988-4.patch
        50 kB
        Eli Collins
      8. hdfs-988-3.patch
        36 kB
        Eli Collins
      9. hdfs-988-2.patch
        34 kB
        Eli Collins
      10. hdfs-988.txt
        25 kB
        Todd Lipcon
      11. HDFS-988.20-security.patch
        10 kB
        Jitendra Nath Pandey
      12. HDFS-988_fix_synchs.patch
        3 kB
        Matt Foley
      13. 988-fixups.txt
        6 kB
        Todd Lipcon

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Eli Collins
              Reporter:
              dhruba borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development