Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15207 Stuck balancer
  3. HBASE-15210

Undo aggressive load balancer logging at tens of lines per millisecond

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.2.0, 1.3.0, 2.0.0
    • Balancer
    • None
    • Reviewed

    Description

      Sometimes the load balancer falls into a state of aggressive logging in 1.2.0 writing out ten lines a millisecond like this:

      2016-02-02 17:15:01,382 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer: Lowest locality region server with non zero regions is ve0540.halxg.cloudera.com with locality 0.22908874
      2016-02-02 17:15:01,382 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer:  Lowest locality region index is 3 and its region server contains 4 regions
      2016-02-02 17:15:01,384 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer: Lowest locality region server with non zero regions is ve0540.halxg.cloudera.com with locality 0.22908874
      2016-02-02 17:15:01,384 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer:  Lowest locality region index is 3 and its region server contains 4 regions
      2016-02-02 17:15:01,386 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer: Lowest locality region server with non zero regions is ve0540.halxg.cloudera.com with locality 0.22908874
      2016-02-02 17:15:01,386 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer:  Lowest locality region index is 2 and its region server contains 4 regions
      2016-02-02 17:15:01,387 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer: Lowest locality region server with non zero regions is ve0540.halxg.cloudera.com with locality 0.22908874
      2016-02-02 17:15:01,387 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer:  Lowest locality region index is 3 and its region server contains 4 regions
      2016-02-02 17:15:01,388 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer: Lowest locality region server with non zero regions is ve0540.halxg.cloudera.com with locality 0.22908874
      2016-02-02 17:15:01,388 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer:  Lowest locality region index is 3 and its region server contains 4 regions
      2016-02-02 17:15:01,388 DEBUG [ve0524.halxg.cloudera.com,16000,1454461776827_ChoreService_1] balancer.BaseLoadBalancer: Lowest locality region server with non zero regions is ve0540.halxg.cloudera.com with locality 0.22908874
      

      This issue is about less logging.

      This log was added recently by this:

      commit 54028140f4f19a6af81c8c8f29dda0c52491a0c9
      Author: tedyu <yuzhihong@gmail.com>
      Date: Thu Aug 13 09:11:59 2015 -0700
      HBASE-13376 Improvements to Stochastic load balancer (Vandana Ayyalasomayajula)

      Attachments

        1. 15210.patch
          2 kB
          Michael Stack

        Activity

          People

            stack Michael Stack
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: