Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11264

Common side changes for HDFS Erasure coding support

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HDFS-7285
    • Fix Version/s: None
    • Component/s: io
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is umbrella JIRA for tracking the common side changes for HDFS Erasure Coding support.

        Attachments

          Issue Links

          is part of

          New Feature - A new feature of the product, which has yet to be developed. HDFS-7285 Erasure Coding Support inside HDFS

          • Major - Major loss of function.
          • Resolved
          is related to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-11842 Common side change for follow-on work for erasure coding phase I

          • Major - Major loss of function.
          • Open
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-12633 Extend Erasure Code to support POWER Chip acceleration

          • Major - Major loss of function.
          • Open
          1.
          		 Raw Erasure Coder API for concrete encoding and decoding Sub-task Resolved Kai Zheng
          2.
          		 Minor improvements for raw erasure coders Sub-task Resolved Kai Zheng
          3.
          		 Raw Reed-Solomon coder using Intel ISA-L library Sub-task Resolved Kai Zheng
          4.
          		 Raw XOR coder Sub-task Resolved Kai Zheng
          5.
          		 Raw Reed-Solomon coder in pure Java Sub-task Resolved Kai Zheng
          6.
          		 Define EC schema API for ErasureCodec Sub-task Resolved Kai Zheng
          7.
          		 Erasure Codec API covering the essential aspects for an erasure code Sub-task Resolved Kai Zheng
          8.
          		 Erasure Coder API for encoding and decoding of block group Sub-task Resolved Kai Zheng
          9.
          		 Reed-Solomon ErasureCoder Sub-task Resolved Kai Zheng
          10.
          		 Loading predefined EC schemas from configuration Sub-task Resolved Kai Zheng
          11.
          		 Make erasure coder configurable Sub-task Resolved Kai Zheng
          12.
          		 Add factory to create raw erasure coder Sub-task Resolved Kai Zheng
          13.
          		 Add API to NetworkTopology for getting all racks Sub-task Resolved Walter Su
          14.
          		 Refine a little bit erasure coder API Sub-task Resolved Kai Zheng
          15.
          		 Combine erasure encoder and decoder interfaces Sub-task Resolved Zhe Zhang
          16.
          		 Correct two thrown messages in ECSchema class Sub-task Resolved Xinwei Qin
          17.
          		 Better to rename some raw erasure coders Sub-task Resolved Kai Zheng
          18.
          		 Minor improvements for erasurecode classes Sub-task Resolved Rakesh Radhakrishnan
          19.
          		 ECSchema are considered as not equal even if they are logically equal Sub-task Open Kai Zheng
          20.
          		 Remove ecschema-def.xml Sub-task Resolved Tsz-wo Sze
          21.
          		 Enhance raw coder allowing to read least required inputs in decoding Sub-task Resolved Kai Zheng
          22.
          		 Enhance erasure coder allowing to read least required inputs in decoding of block group Sub-task Open Kai Zheng
          23.
          		 Introduce Intel ISA-L erasure coding library for native erasure encoding support Sub-task Resolved Kai Zheng
          24.
          		 Erasure coding: Should be able to encode part of parity blocks. Sub-task Resolved Kai Zheng
          25.
          		 Add tests and fix for erasure coders to recover erased parity units Sub-task Resolved Kai Zheng
          26.
          		 Refactor some codes for erasure coders Sub-task Resolved Kai Zheng
          27.
          		 Enhance tests for erasure coders Sub-task Resolved Kai Zheng
          28.
          		 Enhance ByteBuffer version encode/decode API of raw erasure coder Sub-task Resolved Kai Zheng
          29.
          		 Add interface of whether codec has chunk boundary to Erasure coder Sub-task Resolved Unassigned
          30.
          		 Improve and restructure native ISAL support Sub-task Resolved Kai Zheng
          31.
          		 Remove chunkSize from ECSchema as its not required for coders Sub-task Resolved Vinayakumar B
          32.
          		 Address some issues related to ByteBuffer type input/output buffers for raw erasure coders Sub-task Resolved Kai Zheng
          33.
          		 Using more meaningful keys in EC schema Sub-task Resolved Kai Zheng

            Activity

              People

              • Assignee:
                umamaheswararao Uma Maheswara Rao G
                Reporter:
                umamaheswararao Uma Maheswara Rao G
              • Votes:
                0 Vote for this issue
                Watchers:
                16 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: