XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Done
    • None
    • None
    • datanode
    • None

    Description

      According to HDFS-7285 and the design, this handles DataNode side extension and related support for Erasure Coding. More specifically, it implements ECWorker, which reconstructs lost blocks (in striping layout).

      It generally needs to restore BlockGroup and schema information from coding commands from NameNode or other entities, and construct specific coding work to execute. The required block reader, writer, either local or remote, encoder and decoder, will be implemented separately as sub-tasks.

      This JIRA will track all the linked sub-tasks, and is responsible for general discussions and integration for ECWorker. It won't resolve until all the related tasks are done.

      Attachments

        1. HDFS ECWorker Design.pdf
          368 kB
          Li Bo
        2. hdfs-ec-datanode.0108.zip
          37 kB
          skyfly_99
        3. hdfs-ec-datanode.0108.zip
          37 kB
          Li Bo
        4. ECWorker-design-v2.pdf
          430 kB
          Kai Zheng

        Issue Links

          Activity

            People

              libo-intel Li Bo
              drankye Kai Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: