Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1491

Dynamic configuration from Zookeeper watcher

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.6.0
    • Configuration
    • Hide
      - Added the ability to specify custom configuration provider to flume node (use new optional '-confprovider' option to specify class name
      - Added new configuration provider (org.apache.flume.conf.zookeeper.ZooKeeperConfigurationProvider) to load configuration from ZooKeeper node(s) (need to use option '-confprovider' and specify System property 'zookeeper.connectionstring' with the ZooKeeper connection string when starting the flume-node)
      Show
      - Added the ability to specify custom configuration provider to flume node (use new optional '-confprovider' option to specify class name - Added new configuration provider (org.apache.flume.conf.zookeeper.ZooKeeperConfigurationProvider) to load configuration from ZooKeeper node(s) (need to use option '-confprovider' and specify System property 'zookeeper.connectionstring' with the ZooKeeper connection string when starting the flume-node)

    Description

      Currently, Flume only support file-level dynamic configuration. Another frequent usage in practical environment, we would like to manage configuration with Zookeeper, and modify configuration from Web UI to stored file in Zookeeper.

      Flume should support this method with Zookeeper watcher.

      Attachments

        1. FLUME-1491-2.patch
          62 kB
          Christopher Nagy
        2. FLUME-1491-3.patch
          67 kB
          Christopher Nagy
        3. FLUME-1491-4.patch
          55 kB
          Christopher Nagy
        4. FLUME-1491-5.patch
          17 kB
          Ashish Paliwal
        5. FLUME-1491-6.patch
          20 kB
          Ashish Paliwal
        6. FLUME-1491-7.patch
          22 kB
          Ashish Paliwal
        7. FLUME-1491-8.patch
          41 kB
          Zachary Heilbron

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. FLUME-2882 Add Generic configuration provider

          • Major - Major loss of function.
          • Patch Available
          links to

          Web Link Review Request

          Web Link Review Request - FLUME-1491-8.patch

          Activity

            People

              paliwalashish Ashish Paliwal
              dennyy Denny Ye
              Votes:
              2 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: