Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11264

Common side changes for HDFS Erasure coding support

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HDFS-7285
    • Fix Version/s: None
    • Component/s: io
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is umbrella JIRA for tracking the common side changes for HDFS Erasure Coding support.

        Attachments

          Issue Links

          1.
          Raw Erasure Coder API for concrete encoding and decoding Sub-task Resolved Kai Zheng
          2.
          Minor improvements for raw erasure coders Sub-task Resolved Kai Zheng
          3.
          Raw Reed-Solomon coder using Intel ISA-L library Sub-task Resolved Kai Zheng
          4.
          Raw XOR coder Sub-task Resolved Kai Zheng
          5.
          Raw Reed-Solomon coder in pure Java Sub-task Resolved Kai Zheng
          6.
          Define EC schema API for ErasureCodec Sub-task Resolved Kai Zheng
          7.
          Erasure Codec API covering the essential aspects for an erasure code Sub-task Resolved Kai Zheng
          8.
          Erasure Coder API for encoding and decoding of block group Sub-task Resolved Kai Zheng
          9.
          Reed-Solomon ErasureCoder Sub-task Resolved Kai Zheng
          10.
          Loading predefined EC schemas from configuration Sub-task Resolved Kai Zheng
          11.
          Make erasure coder configurable Sub-task Resolved Kai Zheng
          12.
          Add factory to create raw erasure coder Sub-task Resolved Kai Zheng
          13.
          Add API to NetworkTopology for getting all racks Sub-task Resolved Walter Su
          14.
          Refine a little bit erasure coder API Sub-task Resolved Kai Zheng
          15.
          Combine erasure encoder and decoder interfaces Sub-task Resolved Zhe Zhang
          16.
          Correct two thrown messages in ECSchema class Sub-task Resolved Xinwei Qin
          17.
          Better to rename some raw erasure coders Sub-task Resolved Kai Zheng
          18.
          Minor improvements for erasurecode classes Sub-task Resolved Rakesh Radhakrishnan
          19.
          ECSchema are considered as not equal even if they are logically equal Sub-task Open Kai Zheng
          20.
          Remove ecschema-def.xml Sub-task Resolved Tsz-wo Sze
          21.
          Enhance raw coder allowing to read least required inputs in decoding Sub-task Resolved Kai Zheng
          22.
          Enhance erasure coder allowing to read least required inputs in decoding of block group Sub-task Open Kai Zheng
          23.
          Introduce Intel ISA-L erasure coding library for native erasure encoding support Sub-task Resolved Kai Zheng
          24.
          Erasure coding: Should be able to encode part of parity blocks. Sub-task Resolved Kai Zheng
          25.
          Add tests and fix for erasure coders to recover erased parity units Sub-task Resolved Kai Zheng
          26.
          Refactor some codes for erasure coders Sub-task Resolved Kai Zheng
          27.
          Enhance tests for erasure coders Sub-task Resolved Kai Zheng
          28.
          Enhance ByteBuffer version encode/decode API of raw erasure coder Sub-task Resolved Kai Zheng
          29.
          Add interface of whether codec has chunk boundary to Erasure coder Sub-task Resolved Unassigned
          30.
          Improve and restructure native ISAL support Sub-task Resolved Kai Zheng
          31.
          Remove chunkSize from ECSchema as its not required for coders Sub-task Resolved Vinayakumar B
          32.
          Address some issues related to ByteBuffer type input/output buffers for raw erasure coders Sub-task Resolved Kai Zheng
          33.
          Using more meaningful keys in EC schema Sub-task Resolved Kai Zheng

            Activity

              People

              • Assignee:
                umamaheswararao Uma Maheswara Rao G
                Reporter:
                umamaheswararao Uma Maheswara Rao G
              • Votes:
                0 Vote for this issue
                Watchers:
                16 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: