Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21014

Improve Stochastic Balancer to write HDFS favoured node hints for region primary blocks to avoid destroying data locality if needing to use HDFS Balancer

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.1.2
    • Fix Version/s: None
    • Component/s: Balancer
    • Labels:

      Description

      Improve Stochastic Balancer to include the HDFS region location hints to avoid HDFS Balancer destroying data locality.

      Right now according to a mix of docs, jiras and mailing list info it appears that one must change

      hbase.master.loadbalancer.class

      to the org.apache.hadoop.hbase.favored.FavoredNodeLoadBalancer asĀ it looks like this functionality is only within FavoredNodeBalancer and not the standard Stochastic Balancer.

      http://hbase.apache.org/book.html#_hbase_and_hdfs

      This is not ideal because we'd still like to use all the heuristics and work that has gone in the Stochastic Balancer which I believe right now is the best and most mature HBase balancer.

      See also the linked Jiras and this discussion:

      http://apache-hbase.679495.n3.nabble.com/HDFS-Balancer-td4086607.html

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                harisekhon Hari Sekhon
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: