Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-39

Support for collector rebalancing

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 0.9.0
    • 0.9.5
    • Master
    • None

    Description

      Currently, mappings between nodes and collectors change when nodes become disconnected, or when new nodes join the cluster (though through consistent hashing, most existing connections do not wind up getting remapped, preventing the system from thrashing about too much). It would be interesting to allow for custom FailoverChainManager implementations that can adjust mappings based on custom load-based policies, as this would allow one to deal with situations when the collectors are not equivalent (due to bad or busy machines, unexpectedly skewed load, etc). The load could be retrieved from stats in ReportManager.

      Attachments

        Activity

          People

            Unassigned Unassigned
            flume_dvryaboy Disabled imported user
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: