Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8430

Erasure coding: compute file checksum for striped files (stripe by stripe)

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • HDFS-7285
    • None
    • erasure-coding
    • None

    Description

      HADOOP-3981 introduces a distributed file checksum algorithm. It's designed for replicated block.
      DFSClient.getFileChecksum() need some updates, so it can work for striped block group.

      Attachments

        1. HDFS-8430-poc1.patch
          10 kB
          Kai Zheng

        Issue Links

        contains

        Sub-task - The sub-task of the issue HDFS-9694 Make existing DFSClient#getFileChecksum() work for striped blocks

        • Major - Major loss of function.
        • Resolved

        Sub-task - The sub-task of the issue HDFS-9833 Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

        • Major - Major loss of function.
        • Resolved
        depends upon

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-9733 Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

        • Major - Major loss of function.
        • Resolved
        is related to

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-9705 Refine the behaviour of getFileChecksum when length = 0

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            drankye Kai Zheng
            walter.k.su Walter Su
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment