Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11842

Common side change for follow-on work for erasure coding phase I

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This is the common side work for HDFS-8031.

        Attachments

          Issue Links

          1.
          Erasure Coding: Load multiple erasure codecs Sub-task Open Kai Zheng
          2.
          Benchmark framework and test for erasure coders Sub-task Resolved Rui Li
          3.
          Allow to register multiple erasure codecs via service locator Sub-task Open Kai Zheng
          4.
          Add ErasureCodecFactory to create ErasureCodec using codec's short name. Sub-task Resolved Vinayakumar B
          5.
          Extend ECBlock allowing to customize how to read chunks from block Sub-task Open Kai Zheng
          6.
          Native raw erasure coder in XOR codes Sub-task Resolved Sammi Chen
          7.
          Improve RSRawErasureDecoder avoiding unnecessary compuating and recovering Sub-task Open Kai Zheng
          8.
          Inter-operable between Java RS erasure coder and native RS erasure coder Sub-task Resolved Kai Zheng
          9.
          Allow to dump verbose information to ease debugging in raw erasure coders Sub-task Resolved Kai Zheng
          10.
          Generate fixed data to perform erasure coder test Sub-task Resolved Kai Zheng
          11.
          Adjust inputs order for the decode API in raw erasure coder Sub-task Resolved Kai Zheng
          12.
          Implement another Reed-Solomon coder in pure Java Sub-task Resolved Kai Zheng
          13.
          Indicate preference not to affect input buffers during coding in erasure coder Sub-task Resolved Kai Zheng
          14.
          Initialize output buffers with ZERO bytes in erasure coder Sub-task Resolved Kai Zheng
          15.
          Implement the Hitchhiker erasure coding algorithm Sub-task Resolved jack liuquan
          16.
          Erasure Coding: create dummy raw coder to isolate performance issues in testing Sub-task Resolved Rui Li
          17.
          Input buffer position after encode/decode not consistent between different kinds of buffers Sub-task Resolved Rui Li
          18.
          Rename the RS coder from HDFS-RAID as legacy Sub-task Resolved Rui Li
          19.
          Rename the new Java coder and make it default Sub-task Resolved Rui Li
          20.
          Configure raw erasure coders for supported codecs Sub-task Resolved Rui Li
          21.
          Add additional github web site for ISA-L library Sub-task Resolved Li Bo
          22.
          Refactor raw erasure coders Sub-task Resolved Kai Zheng
          23.
          Implement ErasureCodec for HitchHiker XOR coding Sub-task Resolved Kai Sasaki
          24.
          Adding tests for coder utilities Sub-task Resolved Kai Sasaki
          25.
          Refactor erasure coders Sub-task Resolved Kai Sasaki
          26.
          Implement customizable and configurable erasure coders Sub-task Resolved Tim Yao
          27.
          Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010 Sub-task Resolved Sammi Chen
          28.
          Erasure Coding codec should support fallback coder Sub-task Resolved Kai Sasaki
          29.
          Add isErasureCoded() API to FileStatus class Sub-task Resolved Manoj Govindassamy
          30.
          Some refactoring work for erasure coding raw coder Sub-task Resolved Frank Zeng
          31.
          Update the documentation about the new ec codecs config keys Sub-task Resolved Kai Sasaki
          32.
          Confusing failure stack trace when codec fallback is happend Sub-task Resolved Kai Sasaki

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                szetszwo Tsz Wo Nicholas Sze
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: