HBase
  1. HBase
  2. HBASE-9030

Chaos monkey can leave the balancer off.

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: test
    • Labels:
      None

      Description

      Our IT test cluster has been seeing really bad perf because we've seen that the balancer is left off after a few tests.

        Activity

        Hide
        Andrew Purtell added a comment -

        My thought was to put restoring the balancer switch into restoreClusterStatus

        Sure. Reason I suggested the above is putting the cluster into a sane state is both a pre and post step.

        Show
        Andrew Purtell added a comment - My thought was to put restoring the balancer switch into restoreClusterStatus Sure. Reason I suggested the above is putting the cluster into a sane state is both a pre and post step.
        Hide
        Elliott Clark added a comment -

        My thought was to put restoring the balancer switch into restoreClusterStatus

        Show
        Elliott Clark added a comment - My thought was to put restoring the balancer switch into restoreClusterStatus
        Hide
        Andrew Purtell added a comment -

        How about:

        • Rename DoActionsOncePolicy. The name is a bit unfortunate because it runs periodically.
        • Add a new DoActionsOncePolicy that does not inherit from PeriodicPolicy. It's actions would only run once at start() and stop().
        • Add a new Action that enables the balancer.
        • Add a new policy SETUP_ACTION_POLICY that includes only the new balancer enable action.
        • Create the ChaosMonkey with new ChaosMonkey(..., SETUP_ACTION_POLICY, EVERY_MINUTE_RANDOM_ACTION_POLICY)

        ?

        Show
        Andrew Purtell added a comment - How about: Rename DoActionsOncePolicy. The name is a bit unfortunate because it runs periodically. Add a new DoActionsOncePolicy that does not inherit from PeriodicPolicy. It's actions would only run once at start() and stop(). Add a new Action that enables the balancer. Add a new policy SETUP_ACTION_POLICY that includes only the new balancer enable action. Create the ChaosMonkey with new ChaosMonkey(..., SETUP_ACTION_POLICY, EVERY_MINUTE_RANDOM_ACTION_POLICY) ?

          People

          • Assignee:
            Unassigned
            Reporter:
            Elliott Clark
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development