Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1073 Simpler model for Namenode's fs Image and edit Logs
  3. HDFS-1521

Persist transaction ID on disk between NN restarts

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      For HDFS-1073 and other future work, we'd like to have the concept of a transaction ID that is persisted on disk with the image/edits. We already have this concept in the NameNode but it resets to 0 on restart. We can also use this txid to replace the checkpointTime field, I believe.

      Attachments

        1. hdfs-1521.txt
          30 kB
          Todd Lipcon
        2. hdfs-1521.txt
          31 kB
          Todd Lipcon
        3. hdfs-1521.3.txt
          42 kB
          Todd Lipcon
        4. hdfs-1521.4.txt
          45 kB
          Todd Lipcon
        5. hdfs-1521.5.txt
          34 kB
          Todd Lipcon
        6. HDFS-1521.diff
          34 kB
          Ivan Kelly
        7. HDFS-1521.diff
          55 kB
          Ivan Kelly
        8. HDFS-1521.diff
          56 kB
          Ivan Kelly
        9. hdfs-1521.txt
          56 kB
          Todd Lipcon
        10. FSImageFormat.patch
          5 kB
          Konstantin Shvachko
        11. HDFS-1521.diff
          57 kB
          Ivan Kelly
        12. HDFS-1521.diff
          55 kB
          Ivan Kelly

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1580 Add interface for generic Write Ahead Logging mechanisms

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: