Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3077 Quorum-based protocol for reading and writing edit logs
  3. HDFS-3859

QJM: implement md5sum verification

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • QuorumJournalManager (HDFS-3077)
    • None
    • None
    • None

    Description

      When the QJM passes journal segments between nodes, it should use an md5sum field to make sure the data doesn't get corrupted during transit. This also serves as an extra safe-guard to make sure that the data is consistent across all nodes when finalizing a segment.

      Attachments

        1. hdfs-3859.txt
          10 kB
          Todd Lipcon
        2. hdfs-3859-sha1.txt
          13 kB
          Andy Isaacson

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HDFS-3943 QJM: remove currently unused "md5sum" field.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: