Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-10460

Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha1
    • datanode
    • None

    Description

      This jira is HDFS-9833 follow-on task to address reconstructing block and then recalculating block checksum for a particular range query.

      For example,

      // create a file 'stripedFile1' with fileSize = cellSize * numDataBlocks = 65536 * 6 = 393216
FileChecksum stripedFileChecksum = getFileChecksum(stripedFile1, 10, true);

      Attachments

        1. HDFS-10460-00.patch
          27 kB
          Rakesh Radhakrishnan
        2. HDFS-10460-01.patch
          31 kB
          Rakesh Radhakrishnan
        3. HDFS-10460-02.patch
          33 kB
          Rakesh Radhakrishnan
        4. HDFS-10460-03.patch
          34 kB
          Rakesh Radhakrishnan
        5. HDFS-10460-04.patch
          37 kB
          Rakesh Radhakrishnan
        6. HDFS-10460-05.patch
          37 kB
          Rakesh Radhakrishnan

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-9833 Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              rakeshr Rakesh Radhakrishnan
              rakeshr Rakesh Radhakrishnan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: