Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-988

saveNamespace race can corrupt the edits log

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20-append, 0.21.0, 0.22.0
    • Fix Version/s: 0.20-append, 0.20.205.0, 0.22.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      hbase

      Description

      The adminstrator puts the namenode is safemode and then issues the savenamespace command. This can corrupt the edits log. The problem is that when the NN enters safemode, there could still be pending logSycs occuring from other threads. Now, the saveNamespace command, when executed, would save a edits log with partial writes. I have seen this happen on 0.20.

      https://issues.apache.org/jira/browse/HDFS-909?focusedCommentId=12828853&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12828853

        Attachments

        1. saveNamespace.txt
          9 kB
          dhruba borthakur
        2. hdfs-988.txt
          25 kB
          Todd Lipcon
        3. saveNamespace_20-append.patch
          9 kB
          Nicolas Spiegelberg
        4. hdfs-988-2.patch
          34 kB
          Eli Collins
        5. HDFS-988_fix_synchs.patch
          3 kB
          Matt Foley
        6. hdfs-988-3.patch
          36 kB
          Eli Collins
        7. hdfs-988-4.patch
          50 kB
          Eli Collins
        8. hdfs-988-5.patch
          141 kB
          Eli Collins
        9. hdfs-988-b22-1.patch
          20 kB
          Eli Collins
        10. 988-fixups.txt
          6 kB
          Todd Lipcon
        11. hdfs-988-6.patch
          177 kB
          Eli Collins
        12. hdfs-988-7.patch
          183 kB
          Eli Collins
        13. HDFS-988.20-security.patch
          10 kB
          Jitendra Nath Pandey

          Issue Links

            Activity

              People

              • Assignee:
                eli Eli Collins
                Reporter:
                dhruba dhruba borthakur
              • Votes:
                0 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: