Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-101

Create experimental processors to aid in learning

    XMLWordPrintableJSON

Details

    • Task
    • Status: Open
    • Trivial
    • Resolution: Unresolved
    • None
    • None
    • Examples
    • None

    Description

      It will be ideal to provide good 'use-anywhere' processors to allow users to easily setup dataflows anywhere on madeup data both for learning how to command and control nifi as well as design/implementation patterns for building processors.

      Two potentially good examples here are:

      • Processor(s) to interact with IRC (sending/receiving)
        One approach: A single processor which both sends and receives data from a given IRC channel. The user can configure the IRC host, username, password, channel, etc... The connection then is held open and the processor will produce an output flow file for every message received in the IRC channel which will have as attributes the message content, sender, time, etc.. That same processor can also read flow files from its queue which contain message text in an attribute. In this manner the processor can support bidirectional interaction with IRC.

      Would then also be interesting to make it really easy for a user to generate a message via the UI as well as easily to consume a message via the UI. These could be very generic processors/widgets for creation/consumption and good for these sorts of cases.

      There are active IRC channels which are great for demonstration of relatively active datastreams. Weather updates, Wikipedia updates, etc...

      • Processor(s) to interact with RSS/Atom

      This would allow subscription to specific feeds of interest to generate test/variable data. RSS/Atom requires keeping some state which is also an interesting problem to think through.

      Attachments

        Activity

          People

            Unassigned Unassigned
            joewitt Joe Witt
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 0.5h
                0.5h