Details

    • Type: New Feature New Feature
    • Status: Patch Available
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Sinks+Sources
    • Labels:
      None
    • Release Note:
      Adding a new flume source for generic unicast and multicast UDP.

      Description

      There are existent TCP (NetcatSource) and UDP Syslog (SyslogUDPSource) sources for Flume, but nothing that is able to easily consume plain ol' UDP streams. My use case includes unicast UDP, as well as multicast streams.

      I'm working on coding up a generic UDPSource for the Wikimedia Foundation, and was wondering if this would be useful to the Flume community at large. If so, here are some questions:

      If I made a generic UDPSource, a lot could be DRYed and abstracted out of SyslogUDPSource, with SyslogUDPSource becomfing a subclass. Should I bother doing this? I'd almost rather not, as I won't personally be using SyslogUDPSource, so I'd rather not have to test changes there.

      Should UDPSource code live in flume-ng-sources, or in flume-ng-core/src/main/.../sources?

        Activity

        Andrew Otto created issue -
        Andrew Otto made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Release Note Adding a new flume source for generic unicast and multicast UDP.
        Andrew Otto made changes -
        Comment [ This is my first flume patch, so it probably needs lots of review and changes. Thanks! ]
        Andrew Otto made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Andrew Otto made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Andrew Otto made changes -
        Attachment 0001-Adding-new-Flume-UDP-Source.patch [ 12564985 ]
        Andrew Otto made changes -
        Attachment 0001-Adding-new-Flume-UDP-Source.patch [ 12564985 ]
        Andrew Otto made changes -

          People

          • Assignee:
            Unassigned
            Reporter:
            Andrew Otto
          • Votes:
            2 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Time Tracking

              Estimated:
              Original Estimate - 336h
              336h
              Remaining:
              Remaining Estimate - 336h
              336h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development