Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11264 Common side changes for HDFS Erasure coding support
  3. HADOOP-11908

Erasure coding: Should be able to encode part of parity blocks.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: io
    • Labels:
      None

      Description

      public void encode(ByteBuffer[] inputs, ByteBuffer[] outputs);
      

      Currently when we do encode, the outputs are all parity blocks, we should be able to encode part of parity blocks.
      This is required when we do datanode striped block recovery, if one or more parity blocks are missed, we need to do encode to recovery them. Only encode part of parity blocks should be more efficient than all.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                drankye Kai Zheng
                Reporter:
                hitliuyi Yi Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: