Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6133

Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover.

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.0
    • Component/s: balancer & mover, datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Add a feature for replica pinning so that when a replica is pinned in a datanode, it will not be moved by Balancer/Mover. The replica pinning feature can be enabled/disabled by "dfs.datanode.block-pinning.enabled", where the default is false.

      Description

      Currently, run Balancer will destroying Regionserver's data locality.
      If getBlocks could exclude blocks belongs to files which have specific path prefix, like "/hbase", then we can run Balancer without destroying Regionserver's data locality.

        Attachments

        1. HDFS-6133.patch
          24 kB
          yunjiong zhao
        2. HDFS-6133-1.patch
          29 kB
          yunjiong zhao
        3. HDFS-6133-2.patch
          29 kB
          yunjiong zhao
        4. HDFS-6133-3.patch
          22 kB
          yunjiong zhao
        5. HDFS-6133-4.patch
          23 kB
          yunjiong zhao
        6. HDFS-6133-5.patch
          23 kB
          yunjiong zhao
        7. HDFS-6133-6.patch
          24 kB
          yunjiong zhao
        8. HDFS-6133-7.patch
          30 kB
          yunjiong zhao
        9. HDFS-6133-8.patch
          30 kB
          yunjiong zhao
        10. HDFS-6133-9.patch
          37 kB
          yunjiong zhao
        11. HDFS-6133-10.patch
          33 kB
          yunjiong zhao
        12. HDFS-6133-11.patch
          33 kB
          yunjiong zhao

          Issue Links

            Activity

              People

              • Assignee:
                zhaoyunjiong yunjiong zhao
                Reporter:
                zhaoyunjiong yunjiong zhao
              • Votes:
                1 Vote for this issue
                Watchers:
                38 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: