Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.95.2
    • Fix Version/s: 0.95.2
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Added a new StochasticLoadBalancer that when enabled will perform a randomized search for the optimal cluster balance. The new balancer takes into account data locality, storefile size, memstore size, and the evenness of tables over region servers when trying potential new cluster states.

      To enable the new balancer set hbase.master.loadbalancer.class to org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer . It is also recommended to set hbase.master.loadbalance.bytable to false . Lots of different configuration options can be tuned to prioritize costs differently. Explanations of all of the configuration options are available on the JavaDoc for StochasticLoadBalancer.

      StochasticLoadBalancer is the default in 0.96.0
      Show
      Added a new StochasticLoadBalancer that when enabled will perform a randomized search for the optimal cluster balance. The new balancer takes into account data locality, storefile size, memstore size, and the evenness of tables over region servers when trying potential new cluster states. To enable the new balancer set hbase.master.loadbalancer.class to org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer . It is also recommended to set hbase.master.loadbalance.bytable to false . Lots of different configuration options can be tuned to prioritize costs differently. Explanations of all of the configuration options are available on the JavaDoc for StochasticLoadBalancer. StochasticLoadBalancer is the default in 0.96.0

      Description

      Now that balancers are pluggable we should give some options.

      1. ASF.LICENSE.NOT.GRANTED--HBASE-5959.D3189.1.patch
        111 kB
        Phabricator
      2. ASF.LICENSE.NOT.GRANTED--HBASE-5959.D3189.2.patch
        111 kB
        Phabricator
      3. ASF.LICENSE.NOT.GRANTED--HBASE-5959.D3189.3.patch
        111 kB
        Phabricator
      4. ASF.LICENSE.NOT.GRANTED--HBASE-5959.D3189.4.patch
        114 kB
        Phabricator
      5. ASF.LICENSE.NOT.GRANTED--HBASE-5959.D3189.5.patch
        115 kB
        Phabricator
      6. ASF.LICENSE.NOT.GRANTED--HBASE-5959.D3189.6.patch
        115 kB
        Phabricator
      7. ASF.LICENSE.NOT.GRANTED--HBASE-5959.D3189.7.patch
        115 kB
        Phabricator
      8. HBASE-5959-0.patch
        128 kB
        Elliott Clark
      9. HBASE-5959-1.patch
        142 kB
        Elliott Clark
      10. HBASE-5959-11.patch
        162 kB
        Elliott Clark
      11. HBASE-5959-12.patch
        162 kB
        Elliott Clark
      12. HBASE-5959-13.patch
        164 kB
        Elliott Clark
      13. HBASE-5959-14.patch
        164 kB
        Elliott Clark
      14. HBASE-5959-2.patch
        152 kB
        Elliott Clark
      15. HBASE-5959-3.patch
        153 kB
        Elliott Clark
      16. HBASE-5959-6.patch
        146 kB
        Elliott Clark
      17. HBASE-5959-7.patch
        149 kB
        Elliott Clark
      18. HBASE-5959-8.patch
        150 kB
        Elliott Clark
      19. HBASE-5959-9.patch
        152 kB
        Elliott Clark

        Activity

        Elliott Clark created issue -
        Elliott Clark made changes -
        Field Original Value New Value
        Attachment HBASE-5959-0.patch [ 12526209 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-1.patch [ 12526476 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-2.patch [ 12526578 ]
        Elliott Clark made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.96.0 [ 12320040 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-3.patch [ 12526592 ]
        Phabricator made changes -
        Attachment HBASE-5959.D3189.1.patch [ 12526860 ]
        Phabricator made changes -
        Attachment HBASE-5959.D3189.2.patch [ 12526862 ]
        Phabricator made changes -
        Attachment HBASE-5959.D3189.3.patch [ 12526865 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-6.patch [ 12527468 ]
        Phabricator made changes -
        Attachment HBASE-5959.D3189.4.patch [ 12527489 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-7.patch [ 12527497 ]
        Phabricator made changes -
        Attachment HBASE-5959.D3189.5.patch [ 12527726 ]
        Phabricator made changes -
        Attachment HBASE-5959.D3189.6.patch [ 12527937 ]
        Phabricator made changes -
        Attachment HBASE-5959.D3189.7.patch [ 12527938 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-8.patch [ 12528782 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-9.patch [ 12528790 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-11.patch [ 12530097 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-12.patch [ 12530107 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-13.patch [ 12530259 ]
        Elliott Clark made changes -
        Attachment HBASE-5959-14.patch [ 12530263 ]
        stack made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 0.96.0 [ 12320040 ]
        Resolution Fixed [ 1 ]
        Elliott Clark made changes -
        Hadoop Flags Reviewed [ 10343 ]
        Release Note Added a new StochasticLoadBalancer that when enabled will perform a randomized search for the optimal cluster balance. The new balancer takes into account data locality, storefile size, memstore size, and the evenness of tables over region servers when trying potential new cluster states.

        To enable the new balancer set hbase.master.loadbalancer.class to org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer . It is also recommended to set hbase.master.loadbalance.bytable to false . Lots of different configuration options can be tuned to prioritize costs differently. Explanations of all of the configuration options are available on the JavaDoc for StochasticLoadBalancer.
        Fix Version/s 0.96.0 [ 12320040 ]
        Description Now that balancers are pluggable we should give some options.b Now that balancers are pluggable we should give some options.
        Elliott Clark made changes -
        Hadoop Flags Reviewed [ 10343 ]
        stack made changes -
        Release Note Added a new StochasticLoadBalancer that when enabled will perform a randomized search for the optimal cluster balance. The new balancer takes into account data locality, storefile size, memstore size, and the evenness of tables over region servers when trying potential new cluster states.

        To enable the new balancer set hbase.master.loadbalancer.class to org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer . It is also recommended to set hbase.master.loadbalance.bytable to false . Lots of different configuration options can be tuned to prioritize costs differently. Explanations of all of the configuration options are available on the JavaDoc for StochasticLoadBalancer.
        Added a new StochasticLoadBalancer that when enabled will perform a randomized search for the optimal cluster balance. The new balancer takes into account data locality, storefile size, memstore size, and the evenness of tables over region servers when trying potential new cluster states.

        To enable the new balancer set hbase.master.loadbalancer.class to org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer . It is also recommended to set hbase.master.loadbalance.bytable to false . Lots of different configuration options can be tuned to prioritize costs differently. Explanations of all of the configuration options are available on the JavaDoc for StochasticLoadBalancer.

        StochasticLoadBalancer is the default in 0.96.0
        Jonathan Hsieh made changes -
        Fix Version/s 0.95.2 [ 12320040 ]

          People

          • Assignee:
            Elliott Clark
            Reporter:
            Elliott Clark
          • Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development