Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1073 Simpler model for Namenode's fs Image and edit Logs
  3. HDFS-1521

Persist transaction ID on disk between NN restarts

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      For HDFS-1073 and other future work, we'd like to have the concept of a transaction ID that is persisted on disk with the image/edits. We already have this concept in the NameNode but it resets to 0 on restart. We can also use this txid to replace the checkpointTime field, I believe.

      Attachments

        1. HDFS-1521.diff
          55 kB
          Ivan Kelly
        2. HDFS-1521.diff
          57 kB
          Ivan Kelly
        3. FSImageFormat.patch
          5 kB
          Konstantin Shvachko
        4. hdfs-1521.txt
          56 kB
          Todd Lipcon
        5. HDFS-1521.diff
          56 kB
          Ivan Kelly
        6. HDFS-1521.diff
          55 kB
          Ivan Kelly
        7. HDFS-1521.diff
          34 kB
          Ivan Kelly
        8. hdfs-1521.5.txt
          34 kB
          Todd Lipcon
        9. hdfs-1521.4.txt
          45 kB
          Todd Lipcon
        10. hdfs-1521.3.txt
          42 kB
          Todd Lipcon
        11. hdfs-1521.txt
          31 kB
          Todd Lipcon
        12. hdfs-1521.txt
          30 kB
          Todd Lipcon

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1580 Add interface for generic Write Ahead Logging mechanisms

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: