Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1630

Checksum fsedits

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.23.0
    • namenode
    • None
    • Reviewed

    Description

      HDFS-903 calculates a MD5 checksum to a saved image, so that we could verify the integrity of the image at the loading time.

      The other half of the story is how to verify fsedits. Similarly we could use the checksum approach. But since a fsedit file is growing constantly, a checksum per file does not work. I am thinking to add a checksum per transaction. Is it doable or too expensive?

      Attachments

        1. editsChecksum.patch
          16 kB
          Hairong Kuang
        2. editsChecksum1.patch
          17 kB
          Hairong Kuang
        3. editsChecksum2.patch
          17 kB
          Hairong Kuang

        Activity

          People

            hairong Hairong Kuang
            hairong Hairong Kuang
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: