Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-7621

Erasure Coding: update the Balancer/Mover data migration logic

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • Reviewed

    Description

      Currently the Balancer/Mover only considers the distribution of replicas of the same block during data migration: the migration cannot decrease the number of racks. With EC the Balancer and Mover should also take into account the distribution of blocks belonging to the same block group.

      Attachments

        1. HDFS-7621.007.patch
          43 kB
          Walter Su
        2. HDFS-7621.006.patch
          44 kB
          Walter Su
        3. HDFS-7621.005.patch
          43 kB
          Walter Su
        4. HDFS-7621.004.patch
          34 kB
          Walter Su
        5. HDFS-7621.003.patch
          34 kB
          Walter Su
        6. HDFS-7621.002.patch
          34 kB
          Walter Su
        7. HDFS-7621.001.patch
          14 kB
          Walter Su

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HDFS-8501 Erasure Coding: BlockInfoStriped.removeStorage(..) move storage with same blockIndex to front slot

          • Major - Major loss of function.
          • Patch Available
          requires

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8147 Mover should not schedule two replicas to the same DN storage

          • Major - Major loss of function.
          • Closed

          Activity

            People

              walter.k.su Walter Su
              jingzhao Jing Zhao
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: