Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1073

Simpler model for Namenode's fs Image and edit Logs

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      The NameNode's storage layout for its name directories has been reorganized to be more robust. Each edit now has a unique transaction ID, and each file is associated with a transaction ID (for checkpoints) or a range of transaction IDs (for edit logs).
      Show
      The NameNode's storage layout for its name directories has been reorganized to be more robust. Each edit now has a unique transaction ID, and each file is associated with a transaction ID (for checkpoints) or a range of transaction IDs (for edit logs).

      Description

      The naming and handling of NN's fsImage and edit logs can be significantly improved resulting simpler and more robust code.

        Attachments

        1. hdfs-1073-merge.patch
          738 kB
          Todd Lipcon
        2. hdfs-1073-merge.patch
          740 kB
          Todd Lipcon
        3. hdfs-1073-merge.patch
          734 kB
          Todd Lipcon
        4. hdfs-1073-editloading-algos.txt
          37 kB
          Todd Lipcon
        5. hdfs-1073.txt
          207 kB
          Todd Lipcon
        6. hdfs1073.tex
          27 kB
          Todd Lipcon
        7. hdfs1073.pdf
          159 kB
          Todd Lipcon
        8. hdfs1073.pdf
          189 kB
          Todd Lipcon
        9. ASF.LICENSE.NOT.GRANTED--hdfs1073.pdf
          88 kB
          Todd Lipcon

          Issue Links

            Activity

              People

              • Assignee:
                tlipcon Todd Lipcon
                Reporter:
                sanjay.radia Sanjay Radia
              • Votes:
                0 Vote for this issue
                Watchers:
                48 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: