Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6133

Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover.

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.7.0
    • balancer & mover, datanode
    • None
    • Reviewed
    • Add a feature for replica pinning so that when a replica is pinned in a datanode, it will not be moved by Balancer/Mover. The replica pinning feature can be enabled/disabled by "dfs.datanode.block-pinning.enabled", where the default is false.

    Description

      Currently, run Balancer will destroying Regionserver's data locality.
      If getBlocks could exclude blocks belongs to files which have specific path prefix, like "/hbase", then we can run Balancer without destroying Regionserver's data locality.

      Attachments

        1. HDFS-6133.patch
          24 kB
          yunjiong zhao
        2. HDFS-6133-1.patch
          29 kB
          yunjiong zhao
        3. HDFS-6133-10.patch
          33 kB
          yunjiong zhao
        4. HDFS-6133-11.patch
          33 kB
          yunjiong zhao
        5. HDFS-6133-2.patch
          29 kB
          yunjiong zhao
        6. HDFS-6133-3.patch
          22 kB
          yunjiong zhao
        7. HDFS-6133-4.patch
          23 kB
          yunjiong zhao
        8. HDFS-6133-5.patch
          23 kB
          yunjiong zhao
        9. HDFS-6133-6.patch
          24 kB
          yunjiong zhao
        10. HDFS-6133-7.patch
          30 kB
          yunjiong zhao
        11. HDFS-6133-8.patch
          30 kB
          yunjiong zhao
        12. HDFS-6133-9.patch
          37 kB
          yunjiong zhao

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zhaoyunjiong yunjiong zhao Assign to me
            zhaoyunjiong yunjiong zhao
            Votes:
            1 Vote for this issue
            Watchers:
            39 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment