Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11842

Common side change for follow-on work for erasure coding phase I

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      This is the common side work for HDFS-8031.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-11264 Common side changes for HDFS Erasure coding support

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)

          • Major - Major loss of function.
          • Open
          1.
          		 Erasure Coding: Load multiple erasure codecs Sub-task Open Kai Zheng
          2.
          		 Benchmark framework and test for erasure coders Sub-task Resolved Rui Li
          3.
          		 Allow to register multiple erasure codecs via service locator Sub-task Open Kai Zheng
          4.
          		 Add ErasureCodecFactory to create ErasureCodec using codec's short name. Sub-task Resolved Vinayakumar B
          5.
          		 Extend ECBlock allowing to customize how to read chunks from block Sub-task Open Kai Zheng
          6.
          		 Native raw erasure coder in XOR codes Sub-task Resolved Sammi Chen
          7.
          		 Improve RSRawErasureDecoder avoiding unnecessary compuating and recovering Sub-task Open Kai Zheng
          8.
          		 Inter-operable between Java RS erasure coder and native RS erasure coder Sub-task Resolved Kai Zheng
          9.
          		 Allow to dump verbose information to ease debugging in raw erasure coders Sub-task Resolved Kai Zheng
          10.
          		 Generate fixed data to perform erasure coder test Sub-task Resolved Kai Zheng
          11.
          		 Adjust inputs order for the decode API in raw erasure coder Sub-task Resolved Kai Zheng
          12.
          		 Implement another Reed-Solomon coder in pure Java Sub-task Resolved Kai Zheng
          13.
          		 Indicate preference not to affect input buffers during coding in erasure coder Sub-task Resolved Kai Zheng
          14.
          		 Initialize output buffers with ZERO bytes in erasure coder Sub-task Resolved Kai Zheng
          15.
          		 Implement the Hitchhiker erasure coding algorithm Sub-task Resolved jack liuquan
          16.
          		 Erasure Coding: create dummy raw coder to isolate performance issues in testing Sub-task Resolved Rui Li
          17.
          		 Input buffer position after encode/decode not consistent between different kinds of buffers Sub-task Resolved Rui Li
          18.
          		 Rename the RS coder from HDFS-RAID as legacy Sub-task Resolved Rui Li
          19.
          		 Rename the new Java coder and make it default Sub-task Resolved Rui Li
          20.
          		 Configure raw erasure coders for supported codecs Sub-task Resolved Rui Li
          21.
          		 Add additional github web site for ISA-L library Sub-task Resolved Li Bo
          22.
          		 Refactor raw erasure coders Sub-task Resolved Kai Zheng
          23.
          		 Implement ErasureCodec for HitchHiker XOR coding Sub-task Resolved Kai
          24.
          		 Adding tests for coder utilities Sub-task Resolved Kai
          25.
          		 Refactor erasure coders Sub-task Resolved Kai
          26.
          		 Implement customizable and configurable erasure coders Sub-task Resolved Tim Yao
          27.
          		 Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010 Sub-task Resolved Sammi Chen
          28.
          		 Erasure Coding codec should support fallback coder Sub-task Resolved Kai
          29.
          		 Add isErasureCoded() API to FileStatus class Sub-task Resolved Manoj Govindassamy
          30.
          		 Some refactoring work for erasure coding raw coder Sub-task Resolved Frank Zeng
          31.
          		 Update the documentation about the new ec codecs config keys Sub-task Resolved Kai
          32.
          		 Confusing failure stack trace when codec fallback is happend Sub-task Resolved Kai

          Activity

            People

              Unassigned Unassigned
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: