Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1491

Dynamic configuration from Zookeeper watcher

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.6.0
    • Component/s: Configuration
    • Labels:
    • Release Note:
      Hide
      - Added the ability to specify custom configuration provider to flume node (use new optional '-confprovider' option to specify class name
      - Added new configuration provider (org.apache.flume.conf.zookeeper.ZooKeeperConfigurationProvider) to load configuration from ZooKeeper node(s) (need to use option '-confprovider' and specify System property 'zookeeper.connectionstring' with the ZooKeeper connection string when starting the flume-node)
      Show
      - Added the ability to specify custom configuration provider to flume node (use new optional '-confprovider' option to specify class name - Added new configuration provider (org.apache.flume.conf.zookeeper.ZooKeeperConfigurationProvider) to load configuration from ZooKeeper node(s) (need to use option '-confprovider' and specify System property 'zookeeper.connectionstring' with the ZooKeeper connection string when starting the flume-node)

      Description

      Currently, Flume only support file-level dynamic configuration. Another frequent usage in practical environment, we would like to manage configuration with Zookeeper, and modify configuration from Web UI to stored file in Zookeeper.

      Flume should support this method with Zookeeper watcher.

        Attachments

        1. FLUME-1491-2.patch
          62 kB
          Christopher Nagy
        2. FLUME-1491-3.patch
          67 kB
          Christopher Nagy
        3. FLUME-1491-4.patch
          55 kB
          Christopher Nagy
        4. FLUME-1491-5.patch
          17 kB
          Ashish Paliwal
        5. FLUME-1491-6.patch
          20 kB
          Ashish Paliwal
        6. FLUME-1491-7.patch
          22 kB
          Ashish Paliwal
        7. FLUME-1491-8.patch
          41 kB
          Zachary Heilbron

          Issue Links

            Activity

              People

              • Assignee:
                paliwalashish Ashish Paliwal
                Reporter:
                dennyy Denny Ye
              • Votes:
                2 Vote for this issue
                Watchers:
                16 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: