Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-988

saveNamespace race can corrupt the edits log

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20-append, 0.21.0, 0.22.0
    • Fix Version/s: 0.20-append, 0.20.205.0, 0.22.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      hbase

      Description

      The adminstrator puts the namenode is safemode and then issues the savenamespace command. This can corrupt the edits log. The problem is that when the NN enters safemode, there could still be pending logSycs occuring from other threads. Now, the saveNamespace command, when executed, would save a edits log with partial writes. I have seen this happen on 0.20.

      https://issues.apache.org/jira/browse/HDFS-909?focusedCommentId=12828853&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12828853

        Attachments

        1. HDFS-988.20-security.patch
          10 kB
          Jitendra Nath Pandey
        2. hdfs-988-7.patch
          183 kB
          Eli Collins
        3. hdfs-988-6.patch
          177 kB
          Eli Collins
        4. 988-fixups.txt
          6 kB
          Todd Lipcon
        5. hdfs-988-b22-1.patch
          20 kB
          Eli Collins
        6. hdfs-988-5.patch
          141 kB
          Eli Collins
        7. hdfs-988-4.patch
          50 kB
          Eli Collins
        8. hdfs-988-3.patch
          36 kB
          Eli Collins
        9. HDFS-988_fix_synchs.patch
          3 kB
          Matt Foley
        10. hdfs-988-2.patch
          34 kB
          Eli Collins
        11. saveNamespace_20-append.patch
          9 kB
          Nicolas Spiegelberg
        12. hdfs-988.txt
          25 kB
          Todd Lipcon
        13. saveNamespace.txt
          9 kB
          dhruba borthakur

          Issue Links

            Activity

              People

              • Assignee:
                eli Eli Collins
                Reporter:
                dhruba dhruba borthakur
              • Votes:
                0 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: