Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-988

saveNamespace race can corrupt the edits log

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20-append, 0.21.0, 0.22.0
    • Fix Version/s: 0.20-append, 0.20.205.0, 0.22.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      hbase

      Description

      The adminstrator puts the namenode is safemode and then issues the savenamespace command. This can corrupt the edits log. The problem is that when the NN enters safemode, there could still be pending logSycs occuring from other threads. Now, the saveNamespace command, when executed, would save a edits log with partial writes. I have seen this happen on 0.20.

      https://issues.apache.org/jira/browse/HDFS-909?focusedCommentId=12828853&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12828853

        Attachments

        1. saveNamespace.txt
          9 kB
          dhruba borthakur
        2. saveNamespace_20-append.patch
          9 kB
          Nicolas Spiegelberg
        3. hdfs-988-b22-1.patch
          20 kB
          Eli Collins
        4. hdfs-988-7.patch
          183 kB
          Eli Collins
        5. hdfs-988-6.patch
          177 kB
          Eli Collins
        6. hdfs-988-5.patch
          141 kB
          Eli Collins
        7. hdfs-988-4.patch
          50 kB
          Eli Collins
        8. hdfs-988-3.patch
          36 kB
          Eli Collins
        9. hdfs-988-2.patch
          34 kB
          Eli Collins
        10. hdfs-988.txt
          25 kB
          Todd Lipcon
        11. HDFS-988.20-security.patch
          10 kB
          Jitendra Nath Pandey
        12. HDFS-988_fix_synchs.patch
          3 kB
          Matt Foley
        13. 988-fixups.txt
          6 kB
          Todd Lipcon

          Issue Links

            Activity

              People

              • Assignee:
                eli Eli Collins
                Reporter:
                dhruba dhruba borthakur
              • Votes:
                0 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: