HBase
  1. HBase
  2. HBASE-3373

Allow regions to be load-balanced by table

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.6
    • Fix Version/s: 0.94.0
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      There is a parameter, hbase.regions.slop, with default value of 0.2
      This parameter allows actual region count to deviate by this percentage from (ideal) average region count.
      Show
      There is a parameter, hbase.regions.slop, with default value of 0.2 This parameter allows actual region count to deviate by this percentage from (ideal) average region count.

      Description

      From our experience, cluster can be well balanced and yet, one table's regions may be badly concentrated on few region servers.
      For example, one table has 839 regions (380 regions at time of table creation) out of which 202 are on one server.

      It would be desirable for load balancer to distribute regions for specified tables evenly across the cluster. Each of such tables has number of regions many times the cluster size.

      1. HbaseBalancerTest2.java
        3 kB
        Matt Corgan
      2. 3373.txt
        6 kB
        Ted Yu

        Issue Links

          Activity

          Ted Yu made changes -
          Release Note There is a parameter, hbase.regions.slop, with default value of 0.2
          This parameter allows actual region count to deviate by this percentage from (ideal) average region count.
          Lars Hofhansl made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Ted Yu made changes -
          Assignee Zhihong Yu [ zhihyu@ebaysf.com ]
          Ted Yu made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Ted Yu made changes -
          Attachment 3373.txt [ 12509174 ]
          Ted Yu made changes -
          Attachment 3373.txt [ 12509173 ]
          Ted Yu made changes -
          Comment [ -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12509173/3373.txt
            against trunk revision .

              +1 @author. The patch does not contain any @author tags.

              +1 tests included. The patch appears to include 3 new or modified tests.

              -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/651//console

          This message is automatically generated. ]
          Ted Yu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Ted Yu made changes -
          Attachment 3373.txt [ 12509173 ]
          Ted Yu made changes -
          Attachment 3373.txt [ 12509161 ]
          Ted Yu made changes -
          Summary Allow regions of specific table to be load-balanced Allow regions to be load-balanced by table
          Fix Version/s 0.94.0 [ 12316419 ]
          Ted Yu made changes -
          Attachment 3373.txt [ 12509161 ]
          stack made changes -
          Fix Version/s 0.92.0 [ 12314223 ]
          stack made changes -
          Link This issue is part of HBASE-3724 [ HBASE-3724 ]
          Matt Corgan made changes -
          Attachment HbaseBalancerTest.java [ 12469716 ]
          Matt Corgan made changes -
          Attachment HbaseBalancerTest2.java [ 12469717 ]
          Matt Corgan made changes -
          Attachment HbaseBalancerTest.java [ 12469716 ]
          stack made changes -
          Fix Version/s 0.92.0 [ 12314223 ]
          Fix Version/s 0.90.1 [ 12315548 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HBASE-2480 [ HBASE-2480 ]
          Ted Yu made changes -
          Field Original Value New Value
          Description From our experience, cluster can be well balanced and yet, one table's regions may be badly concentrated on few region servers.
          For example, one table has 839 regions (380 regions at time of table creation) out of which 202 are on one server.

          It would be desirable for load balancer to distribute regions for specified table evenly across the cluster.
          From our experience, cluster can be well balanced and yet, one table's regions may be badly concentrated on few region servers.
          For example, one table has 839 regions (380 regions at time of table creation) out of which 202 are on one server.

          It would be desirable for load balancer to distribute regions for specified tables evenly across the cluster. Each of such tables has number of regions many times the cluster size.
          Ted Yu created issue -

            People

            • Assignee:
              Ted Yu
              Reporter:
              Ted Yu
            • Votes:
              3 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development