Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
nifi-minifi-cpp agents can generate multiple "streams" of flowfiles.
For instance, to monitor a host, nifi-minifi-cpp runs nmon, ps, netstat, and gathers logfiles from applications.
But, for a given flowfile, any downstream NiFi collectors wont have visibility into the originating hostname, nor metadata about which "stream" (ExecuteProcess(nmon), ExecuteProcess(ps), TailFile(app1), TailFile(app2)) generated it.
One solution is to use a separate InputPort for each stream. This works, but burdens both the team working on agent flows, and the team managing the collector- they have to be in concert.
A simpler (better?) approach is to allow agent teams to tag flowfiles with differentiating metadata via use of UpdateAttribute.
Attachments
Issue Links
- links to