Uploaded image for project: 'Bookkeeper'
  1. Bookkeeper
  2. BOOKKEEPER-363

Re-distributing topics among newly added hubs.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 4.2.0
    • 4.3.0
    • hedwig-server
    • None

    Description

      When a new hub is added to an already existing hedwig cluster, that hub should pick up some of the topics. Currently the mechanism hedwig provides is to configure the time for which a topic is retained. A better approach might be to run a re-balancer thread that periodically checks if topics are distributed evenly among hubs and if not, releases some topics to balance the load.

      https://reviews.apache.org/r/6700/
      There is a race condition while updating load as mentioned in the comments and that is not handled in this review.

      Attachments

        1. BOOKKEEPER-363.diff
          51 kB
          Sijie Guo
        2. BK-363.patch.v2
          43 kB
          Aniruddha
        3. BK-363.patch
          39 kB
          Aniruddha

        Activity

          People

            i0exception Aniruddha
            i0exception Aniruddha
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: