Uploaded image for project: 'Bookkeeper'
  1. Bookkeeper
  2. BOOKKEEPER-363

Re-distributing topics among newly added hubs.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.2.0
    • Fix Version/s: 4.3.0
    • Component/s: hedwig-server
    • Labels:
      None

      Description

      When a new hub is added to an already existing hedwig cluster, that hub should pick up some of the topics. Currently the mechanism hedwig provides is to configure the time for which a topic is retained. A better approach might be to run a re-balancer thread that periodically checks if topics are distributed evenly among hubs and if not, releases some topics to balance the load.

      https://reviews.apache.org/r/6700/
      There is a race condition while updating load as mentioned in the comments and that is not handled in this review.

        Attachments

        1. BK-363.patch
          39 kB
          Aniruddha
        2. BK-363.patch.v2
          43 kB
          Aniruddha
        3. BOOKKEEPER-363.diff
          51 kB
          Sijie Guo

          Activity

            People

            • Assignee:
              i0exception Aniruddha
              Reporter:
              i0exception Aniruddha
            • Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: