Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11347 [Umbrella] Converting files from replicated to striped EC
  3. HDFS-7717

Erasure Coding: distribute replication to EC conversion work to DataNode

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      In stripping erasure coding case, we need some approach to distribute conversion work between replication and stripping erasure coding to DataNode. It can be NameNode, or a tool utilizing MR just like the current distcp, or another one like the balancer/mover.

      Attachments

        Issue Links

          is duplicated by

          Task - A task that needs to be done. HDFS-11075 Provide a tool to help covert existing file of default 3x replication to EC striped layout

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HDFS-8023 Erasure Coding: retrieve eraure coding schema for a file from NameNode

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HDFS-7344 [umbrella] Erasure Coding worker and support in DataNode

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Sammi Sammi Chen
              jingzhao Jing Zhao
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated: