Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8005

Erasure Coding: simplify striped block recovery work computation and add tests

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      HDFS-7369 adds the functionality to distribute recovery work of striped blocks to datanodes. There are still some pending issues:

      1. In BlockManager#chooseSourceNode, a node is added into healthyIndices without checking if its block is live and healthy
      2. The test TestRecoverStripedBlcoks#testMissingStripedBlock has not tested striped blocks because the file is created before setting the storage policy
      3. In computeRecoveryWorkForBlocks, instead of using BlockCollection#isStriped, we'd better use BlockInfo#isStriped

      Attachments

        1. HDFS-8005.000.patch
          34 kB
          Jing Zhao
        2. HDFS-8005.000.patch
          34 kB
          Jing Zhao
        3. HDFS-8005.001.patch
          35 kB
          Jing Zhao

        Activity

          People

            jingzhao Jing Zhao
            jingzhao Jing Zhao
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: