Flume
  1. Flume
  2. FLUME-1491

Dynamic configuration from Zookeeper watcher

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.2.0
    • Fix Version/s: None
    • Component/s: Configuration
    • Labels:
    • Release Note:
      Hide
      - Added the ability to specify custom configuration provider to flume node (use new optional '-confprovider' option to specify class name
      - Added new configuration provider (org.apache.flume.conf.zookeeper.ZooKeeperConfigurationProvider) to load configuration from ZooKeeper node(s) (need to use option '-confprovider' and specify System property 'zookeeper.connectionstring' with the ZooKeeper connection string when starting the flume-node)
      Show
      - Added the ability to specify custom configuration provider to flume node (use new optional '-confprovider' option to specify class name - Added new configuration provider (org.apache.flume.conf.zookeeper.ZooKeeperConfigurationProvider) to load configuration from ZooKeeper node(s) (need to use option '-confprovider' and specify System property 'zookeeper.connectionstring' with the ZooKeeper connection string when starting the flume-node)

      Description

      Currently, Flume only support file-level dynamic configuration. Another frequent usage in practical environment, we would like to manage configuration with Zookeeper, and modify configuration from Web UI to stored file in Zookeeper.

      Flume should support this method with Zookeeper watcher.

      1. FLUME-1491-8.patch
        41 kB
        Zachary Heilbron
      2. FLUME-1491-7.patch
        22 kB
        Ashish Paliwal
      3. FLUME-1491-6.patch
        20 kB
        Ashish Paliwal
      4. FLUME-1491-5.patch
        17 kB
        Ashish Paliwal
      5. FLUME-1491-4.patch
        55 kB
        Christopher Nagy
      6. FLUME-1491-3.patch
        67 kB
        Christopher Nagy
      7. FLUME-1491-2.patch
        62 kB
        Christopher Nagy

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Ashish Paliwal
              Reporter:
              Denny Ye
            • Votes:
              2 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development