Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8430

Erasure coding: compute file checksum for striped files (stripe by stripe)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • HDFS-7285
    • None
    • erasure-coding
    • None

    Description

      HADOOP-3981 introduces a distributed file checksum algorithm. It's designed for replicated block.
      DFSClient.getFileChecksum() need some updates, so it can work for striped block group.

      Attachments

        1. HDFS-8430-poc1.patch
          10 kB
          Kai Zheng

        Issue Links

          contains

          Sub-task - The sub-task of the issue HDFS-9694 Make existing DFSClient#getFileChecksum() work for striped blocks

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-9833 Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

          • Major - Major loss of function.
          • Resolved
          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9733 Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9705 Refine the behaviour of getFileChecksum when length = 0

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              drankye Kai Zheng
              walter.k.su Walter Su
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated: