Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11264 Common side changes for HDFS Erasure coding support
  3. HADOOP-11646

Erasure Coder API for encoding and decoding of block group

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      This is to define ErasureCoder API for encoding and decoding of BlockGroup. Given a BlockGroup, ErasureCoder extracts data chunks from the blocks and leverages RawErasureCoder defined in HADOOP-11514 to perform concrete encoding or decoding. Note this mainly focuses on the basic fundamental aspects, and solves encoding, data blocks recovering and etc. Regarding parity blocks recovering, as it involves multiple steps, HADOOP-11550 will handle it.

      Attachments

        1. HDFS-7662-v1.patch
          26 kB
          Kai Zheng
        2. HDFS-7662-v2.patch
          88 kB
          Kai Zheng
        3. HDFS-7662-v3.patch
          47 kB
          Kai Zheng
        4. HADOOP-11646-v4.patch
          46 kB
          Kai Zheng
        5. HADOOP-11646-v5.patch
          48 kB
          Kai Zheng

        Issue Links

          incorporates

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11550 Enhance ErasureCoder API to support multiple encoding/decoding steps

          • Major - Major loss of function.
          • Open
          is depended upon by

          Sub-task - The sub-task of the issue HADOOP-11647 Reed-Solomon ErasureCoder

          • Major - Major loss of function.
          • Resolved
          is part of

          New Feature - A new feature of the product, which has yet to be developed. HDFS-7337 Configurable and pluggable erasure codec and policy

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          requires

          Sub-task - The sub-task of the issue HADOOP-11514 Raw Erasure Coder API for concrete encoding and decoding

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              drankye Kai Zheng
              drankye Kai Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: