Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2351

Ability to override any parameter from the configuration file

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.5.0
    • Fix Version/s: None
    • Component/s: Node
    • Labels:

      Description

      To start flume agents dynamically it comes handy to be able to override parameters of a base configuration file without actually touching and modifying it, for example change the bind port.

      Example:

      agent.sources.avro-collection-source.bind = localhost
      agent.sources.avro-collection-source.port = 50000
      agent.sinks.hdfs-sink.hdfs.path = hdfs://localhost:9000/flume
      agent.channels.memoryChannel.capacity = 20000

      flume-ng agent -n agent -f flume.conf
      -o avro-collection-source.bind=0.0.0.0
      -o avro-collection-source.port=30000
      -o hdfs-sink.hdfs.path=hdfs://localhost:9000/data
      -o memoryChannel.capacity=30000

      1. FLUME-2351.patch
        11 kB
        Krisztian Horvath
      2. FLUME-2351-2.patch
        12 kB
        Krisztian Horvath

        Issue Links

          Activity

          Hide
          keyki Krisztian Horvath added a comment -

          renamed patch

          Show
          keyki Krisztian Horvath added a comment - renamed patch
          Hide
          keyki Krisztian Horvath added a comment -

          please review

          Show
          keyki Krisztian Horvath added a comment - please review
          Hide
          brocknoland Brock Noland added a comment -

          Generally I think this is ok. I don't see it documented in the flume-ng command? Also the link to RB is wrong.

          Show
          brocknoland Brock Noland added a comment - Generally I think this is ok. I don't see it documented in the flume-ng command? Also the link to RB is wrong.
          Hide
          keyki Krisztian Horvath added a comment -

          Fixed the RB link and I'll add the appropriate documentation as well.

          Show
          keyki Krisztian Horvath added a comment - Fixed the RB link and I'll add the appropriate documentation as well.
          Hide
          keyki Krisztian Horvath added a comment - - edited

          added documentation to flume-ng

          Show
          keyki Krisztian Horvath added a comment - - edited added documentation to flume-ng
          Hide
          roshan_naik Roshan Naik added a comment -

          RB request does not seem to have been created correctly. Did you upload the patch file when asked to upload the diff ? did u choose flume-git as the repo when creating the request ?

          Show
          roshan_naik Roshan Naik added a comment - RB request does not seem to have been created correctly. Did you upload the patch file when asked to upload the diff ? did u choose flume-git as the repo when creating the request ?
          Hide
          keyki Krisztian Horvath added a comment -

          Created a new one.

          Show
          keyki Krisztian Horvath added a comment - Created a new one.

            People

            • Assignee:
              Unassigned
              Reporter:
              keyki Krisztian Horvath
            • Votes:
              6 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:

                Development