Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13965

Stochastic Load Balancer JMX Metrics

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0, 2.0.0
    • Component/s: Balancer, metrics
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Today’s default HBase load balancer (the Stochastic load balancer) is cost function based. The cost function weights are tunable but no visibility into those cost function results is directly provided.

      A driving example is a cluster we have been tuning which has skewed rack size (one rack has half the nodes of the other few racks). We are tuning the cluster for uniform response time from all region servers with the ability to tolerate a rack failure. Balancing LocalityCost, RegionReplicaRack Cost and RegionCountSkew Cost is difficult without a way to attribute each cost function’s contribution to overall cost.
      What this jira proposes is to provide visibility via JMX into each cost function of the stochastic load balancer, as well as the overall cost of the balancing plan.

        Attachments

        1. 13965-addendum.txt
          1 kB
          Ted Yu
        2. HBASE-13965_v2.patch
          26 kB
          Lei Chen
        3. HBASE-13965-branch-1.patch
          49 kB
          Lei Chen
        4. HBASE-13965-branch-1-v2.patch
          49 kB
          Lei Chen
        5. HBase-13965-JConsole.png
          80 kB
          Lei Chen
        6. HBase-13965-v1.patch
          50 kB
          Lei Chen
        7. HBASE-13965-v10.patch
          44 kB
          Lei Chen
        8. HBASE-13965-v11.patch
          45 kB
          Lei Chen
        9. HBASE-13965-v3.patch
          28 kB
          Lei Chen
        10. HBASE-13965-v4.patch
          29 kB
          Lei Chen
        11. HBASE-13965-v5.patch
          28 kB
          Lei Chen
        12. HBASE-13965-v6.patch
          29 kB
          Lei Chen
        13. HBASE-13965-v7.patch
          44 kB
          Lei Chen
        14. HBASE-13965-v8.patch
          44 kB
          Lei Chen
        15. HBASE-13965-v9.patch
          44 kB
          Lei Chen
        16. stochasticloadbalancerclasses_v2.png
          134 kB
          Lei Chen

          Activity

            People

            • Assignee:
              leochen4891 Lei Chen
              Reporter:
              leochen4891 Lei Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: