Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-8062

Remove hard-coded values in favor of EC schema

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      Related issues about EC schema in NameNode side:
      HDFS-7859 is to change fsimage and editlog in NameNode to persist EC schemas;
      HDFS-7866 is to manage EC schemas in NameNode, loading, syncing between persisted ones in image and predefined ones in XML.

      This is to revisit all the places in NameNode that uses hard-coded values in favor of ECSchema.

      Attachments

        1. HDFS-8062.1.patch
          6 kB
          Kai Sasaki
        2. HDFS-8062.2.patch
          39 kB
          Kai Sasaki
        3. HDFS-8062.3.patch
          45 kB
          Kai Sasaki
        4. HDFS-8062.4.patch
          40 kB
          Kai Sasaki
        5. HDFS-8062.5.patch
          47 kB
          Kai Sasaki
        6. HDFS-8062.6.patch
          70 kB
          Kai Sasaki
        7. HDFS-8062-HDFS-7285-07.patch
          46 kB
          Kai Sasaki
        8. HDFS-8062-HDFS-7285-08.patch
          46 kB
          Kai Sasaki

        Issue Links

          contains

          Sub-task - The sub-task of the issue HDFS-8136 Client gets and uses EC schema when reads and writes a stripping file

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Sub-task - The sub-task of the issue HDFS-8367 BlockInfoStriped uses EC schema

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-8494 Remove hard-coded chunk size in favor of ECZone

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Sub-task - The sub-task of the issue HDFS-8882 Erasure Coding: Use datablocks, parityblocks and cell size from ErasureCodingPolicy

          • Major - Major loss of function.
          • Resolved
          is required by

          Task - A task that needs to be done. HDFS-8020 Erasure Coding: constructing and mapping BlockGroup info to utilize and call ErasureCoder API

          • Major - Major loss of function.
          • Patch Available
          relates to

          Sub-task - The sub-task of the issue HDFS-8530 Restore ECZone info inside FSImageLoader

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              kaisasak Kai Sasaki
              drankye Kai Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: