Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8425 [umbrella] Performance tuning, investigation and optimization for erasure coding
  3. HDFS-8019

Erasure Coding: erasure coding chunk buffer allocation and management

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      As a task of HDFS-7344, this is to come up a chunk buffer pool allocating and managing coding chunk buffers, either based on on-heap or off-heap. Note this assumes some DataNodes are powerful in computing and performing EC coding work, so better to have this dedicated buffer pool and management.

      Attachments

        1. HDFS-8019-HDFS-7285-01.patch
          15 kB
          Vinayakumar B
        2. HDFS-8019-HDFS-7285-02.patch
          23 kB
          Vinayakumar B

        Issue Links

          Is contained by

          Sub-task - The sub-task of the issue HDFS-7344 [umbrella] Erasure Coding worker and support in DataNode

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vinayakumarb Vinayakumar B
              drankye Kai Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: