Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-7866

Erasure coding: NameNode manages multiple erasure coding policies

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      This is to extend NameNode to load, list and sync predefine EC schemas in authorized and controlled approach. The provided facilities will be used to implement DFSAdmin commands so admin can list available EC schemas, then could choose some of them for target EC zones.

      Attachments

        1. HDFS-7866.13.patch
          37 kB
          Rui Li
        2. HDFS-7866.12.patch
          37 kB
          Rui Li
        3. HDFS-7866.11.patch
          37 kB
          Rui Li
        4. HDFS-7866.10.patch
          36 kB
          Rui Li
        5. HDFS-7866.9.patch
          35 kB
          Rui Li
        6. HDFS-7866.8.patch
          31 kB
          Rui Li
        7. HDFS-7866.7.patch
          78 kB
          Rui Li
        8. HDFS-7866.6.patch
          74 kB
          Rui Li
        9. HDFS-7866.5.patch
          73 kB
          Rui Li
        10. HDFS-7866.4.patch
          66 kB
          Rui Li
        11. HDFS-7866-v3.patch
          15 kB
          Kai Zheng
        12. HDFS-7866-v2.patch
          14 kB
          Kai Zheng
        13. HDFS-7866-v1.patch
          6 kB
          Kai Zheng

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HADOOP-11664 Loading predefined EC schemas from configuration

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-7859 Erasure Coding: Persist erasure coding policies in NameNode

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue HDFS-8090 Erasure Coding: Add RPC to client-namenode to list all ECSchemas loaded in Namenode.

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Sub-task - The sub-task of the issue HDFS-8109 ECManager should be able to manage multiple ECSchemas

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HDFS-7839 Erasure coding: implement facilities in NameNode to create and manage EC zones

          • Major - Major loss of function.
          • Resolved

          Test - A new unit, integration or system test. HDFS-9962 Erasure Coding: need a way to test multiple EC policies

          • Major - Major loss of function.
          • Open
          requires

          Sub-task - The sub-task of the issue HDFS-9658 Erasure Coding: allow to use multiple EC policies in striping related tests

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-9755 Erasure Coding: allow to use multiple EC policies in striping related tests [Part 2]

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-9816 Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              lirui Rui Li
              drankye Kai Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: