Flume
  1. Flume
  2. FLUME-195

Allow custom Flume OutputFormats via a plugin interface

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v0.9.5
    • Component/s: Node, Sinks+Sources, Test
    • Labels:
      None

      Description

      Flume should permit custom OutputFormats so users can do things like:

      foo : collectorSource | console("myCustomFormat")
      bar : collectorSource | text("/some/file", "myCustomFormat")

      Built in formats should be automatically registered as they are now.

        Issue Links

          Activity

          E. Sammer created issue -
          E. Sammer made changes -
          Field Original Value New Value
          Description Flume should permit custom OutputFormats so users can do things like:

          {code}
          foo : collectorSource | console("myCustomFormat")
          bar : collectorSource | text("/some/file", "myCustomFormat")
          {code}

          Built in formats should be automatically registered as they are now.
          Flume should permit custom OutputFormats so users can do things like:

          foo : collectorSource | console("myCustomFormat")
          bar : collectorSource | text("/some/file", "myCustomFormat")

          Built in formats should be automatically registered as they are now.
          Hide
          E. Sammer added a comment -

          Initial stab at an implementation up for review at https://review.cloudera.org/r/773/

          Show
          E. Sammer added a comment - Initial stab at an implementation up for review at https://review.cloudera.org/r/773/
          Hide
          Disabled imported user added a comment -

          Reminds me of a similar issue in Sqoop

          Show
          Disabled imported user added a comment - Reminds me of a similar issue in Sqoop
          Disabled imported user made changes -
          Link This issue relates to SQOOP-1 [ SQOOP-1 ]
          E. Sammer made changes -
          Status Open [ 1 ] Patch Available [ 10000 ]
          E. Sammer made changes -
          Link This issue blocks FLUME-292 [ FLUME-292 ]
          Hide
          E. Sammer added a comment -

          Pushed to master.

          Show
          E. Sammer added a comment - Pushed to master.
          E. Sammer made changes -
          Status Patch Available [ 10000 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Mark Thomas made changes -
          Project Import Tue Aug 02 16:57:12 UTC 2011 [ 1312304232406 ]
          Arvind Prabhakar made changes -
          Fix Version/s v0.9.5 [ 12317558 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Blocked Blocked
          3d 23h 8m 1 E. Sammer 06/Sep/10 22:07
          Blocked Blocked Resolved Resolved
          62d 2h 9m 1 E. Sammer 07/Nov/10 23:16

            People

            • Assignee:
              E. Sammer
              Reporter:
              E. Sammer
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development