Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-299

Add support for subarguments in flume config elements

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.4
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      It would make sense for certain arguments to have sub-arguments.

      For example, when specifiying the console("avro") sink, it would be nice to give the avro output format arguments. So we could be able to say 'console(avro("json"))' or 'console(avro("bin","gzip"))'

      This would also allow roll sinks to specify different trigger policies:

      'roll( timer(1000))

      { ... }' // roll every second
      'roll( count(100)) { ... }

      ' // roll every 100 events
      'roll( countTimer(100,1000))

      { ... }

      ' // roll every 100 events or every 1000 ms
      'roll( size(1000000) )

      {... }

      ' // roll every 1000000 bytes.

      It would also allow failovers sinks to specify retry policies.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jmhsieh Jonathan Hsieh
                Reporter:
                jmhsieh Jonathan Hsieh
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: