Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3077 Quorum-based protocol for reading and writing edit logs
  3. HDFS-3943

QJM: remove currently unused "md5sum" field.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: QuorumJournalManager (HDFS-3077)
    • Fix Version/s: QuorumJournalManager (HDFS-3077)
    • Component/s: ha
    • Labels:
      None

      Description

      Per later discussion in HDFS-3859, it turns out to be rather difficult to integrate md5sum verification into QJM at this point. The crux of the issue is that different replicas may be semantically identical, but bytewise unequal due to the padding at the end of the file.

      Given this, I'd like to temporarily remove the "md5sum" field from the protocol while we work on the more complex verification (which ignores the trailing padding) in HDFS-3859.

        Attachments

        1. hdfs-3943.txt
          5 kB
          Todd Lipcon

          Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-3859 QJM: implement md5sum verification

          • Major - Major loss of function.
          • Open

            Activity

              People

              • Assignee:
                tlipcon Todd Lipcon
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: