Uploaded image for project: 'Apache Helix'
  1. Apache Helix
  2. HELIX-674

Constraint Based Resource Rebalancer

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 0.8.x
    • Component/s: None
    • Labels:
      None

      Description

      Helix rebalancer assigns resources according to different strategies. Recently, we optimize the strategy for evenness and minimize movement. However, the evenness here only applies to partition numbers. Moreover, we've got more requests for customizable rebalancer from our users.

      Take partition weight as an example:
      In reality, partition replicas have different size. We use "partition weight" as an abstraction of the partition size. It can be network traffic usage, disk usage, or any other combined factors.
      Given each partition may have different weights, Helix should be able to assign partition accordingly. So that the distribution would be even regarding the weight.

      In this project, we are planning new rebalancer mechanism that generates resource partition assignment according to a list of "constraints". Current rebalance strategy can be regarded as one kind of constraint. Moving forward, Helix users would be able to extend the constraint interface using their own logic.

      Some init discussions are in progress and we will have a proposal posted here soon.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jiajunwang Jiajun Wang
                Reporter:
                jiajunwang Jiajun Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: