Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-101

Create experimental processors to aid in learning

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Open
    • Priority: Trivial
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Examples
    • Labels:
      None

      Description

      It will be ideal to provide good 'use-anywhere' processors to allow users to easily setup dataflows anywhere on madeup data both for learning how to command and control nifi as well as design/implementation patterns for building processors.

      Two potentially good examples here are:

      • Processor(s) to interact with IRC (sending/receiving)
        One approach: A single processor which both sends and receives data from a given IRC channel. The user can configure the IRC host, username, password, channel, etc... The connection then is held open and the processor will produce an output flow file for every message received in the IRC channel which will have as attributes the message content, sender, time, etc.. That same processor can also read flow files from its queue which contain message text in an attribute. In this manner the processor can support bidirectional interaction with IRC.

      Would then also be interesting to make it really easy for a user to generate a message via the UI as well as easily to consume a message via the UI. These could be very generic processors/widgets for creation/consumption and good for these sorts of cases.

      There are active IRC channels which are great for demonstration of relatively active datastreams. Weather updates, Wikipedia updates, etc...

      • Processor(s) to interact with RSS/Atom

      This would allow subscription to specific feeds of interest to generate test/variable data. RSS/Atom requires keeping some state which is also an interesting problem to think through.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              joewitt Joe Witt
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: