HBase
  1. HBase
  2. HBASE-9267

StochasticLoadBalancer goes over its processing time limit

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.95.2
    • Fix Version/s: 0.98.0, 0.96.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I trying out 0.95.2, I left it running over the weekend (8 RS, average load between 12 and 3 regions) and right now the balancer runs for 12 mins:

      2013-08-19 21:54:45,534 DEBUG [jdec2hbase0403-1.vpc.cloudera.com,60000,1376689696384-BalancerChore] org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer: Could not find a better load balance plan. Tried 0 different configurations in 777309ms, and did not find anything with a computed cost less than 36.32576937689094

      It seems it slowly crept up there, yesterday it was doing:

      2013-08-18 20:53:17,232 DEBUG [jdec2hbase0403-1.vpc.cloudera.com,60000,1376689696384-BalancerChore] org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer: Could not find a better load balance plan. Tried 0 different configurations in 257374ms, and did not find anything with a computed cost less than 36.3251082542424

      And originally it was doing 1 minute.

      In the jstack I see a 1000 of these and jstack doesn't want to show me the whole thing:

      at java.util.SubList$1.nextIndex(AbstractList.java:713)

      1. HBASE-9267-4.patch
        11 kB
        Elliott Clark
      2. HBASE-9267-3.patch
        11 kB
        Elliott Clark
      3. HBASE-9267-2.patch
        11 kB
        Elliott Clark
      4. HBASE-9267-1.patch
        11 kB
        Elliott Clark
      5. HBASE-9267-0.patch
        11 kB
        Elliott Clark

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Elliott Clark
            Reporter:
            Jean-Daniel Cryans
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development