Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-988

saveNamespace race can corrupt the edits log

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20-append, 0.21.0, 0.22.0
    • Fix Version/s: 0.20-append, 0.20.205.0, 0.22.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      hbase

      Description

      The adminstrator puts the namenode is safemode and then issues the savenamespace command. This can corrupt the edits log. The problem is that when the NN enters safemode, there could still be pending logSycs occuring from other threads. Now, the saveNamespace command, when executed, would save a edits log with partial writes. I have seen this happen on 0.20.

      https://issues.apache.org/jira/browse/HDFS-909?focusedCommentId=12828853&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12828853

      1. HDFS-988.20-security.patch
        10 kB
        Jitendra Nath Pandey
      2. hdfs-988-7.patch
        183 kB
        Eli Collins
      3. hdfs-988-6.patch
        177 kB
        Eli Collins
      4. 988-fixups.txt
        6 kB
        Todd Lipcon
      5. hdfs-988-b22-1.patch
        20 kB
        Eli Collins
      6. hdfs-988-5.patch
        141 kB
        Eli Collins
      7. hdfs-988-4.patch
        50 kB
        Eli Collins
      8. hdfs-988-3.patch
        36 kB
        Eli Collins
      9. HDFS-988_fix_synchs.patch
        3 kB
        Matt Foley
      10. hdfs-988-2.patch
        34 kB
        Eli Collins
      11. saveNamespace_20-append.patch
        9 kB
        Nicolas Spiegelberg
      12. hdfs-988.txt
        25 kB
        Todd Lipcon
      13. saveNamespace.txt
        9 kB
        dhruba borthakur

        Issue Links

          Activity

            People

            • Assignee:
              Eli Collins
              Reporter:
              dhruba borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development