Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-6851

Improve Provenance RECEIVE and FETCH events to allow for specifics on how flowfile was RECEIVE'ed/FETCH'ed

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 1.10.0
    • None
    • Core Framework
    • None

    Description

      Currently there is no way to know if a Provenance RECEIVE or FETCH event is the result of an active (i.e. GetFTP, FetchFTP, GetHTTP), passive (i.e. ListenHTTP)  or query (i.e. GetMongo) event.

      There was a discussion on the dev mailing lists regarding the most graceful way to do this [1] [2]

       

      At this time the smoothest path forward is to keep the current method signatures of receive() and fetch() as is in ProvenanceReporter.java [3]

      and to add new fetch() and receive()'s with a new parameter:
      receive(...,ACTIVE|PASSIVE|QUERY)

      If not specified it would be UNSPECIFIED. 

      (Thank You joewitt for this solution)

       

       

      [1] https://mail-archives.apache.org/mod_mbox/nifi-dev/201910.mbox/browser , topic of PULL ProvenanceEvent

      [2] https://mail-archives.apache.org/mod_mbox/nifi-dev/201911.mbox/browser , topic of Re: PULL ProvenanceEvent

      [3] https://github.com/apache/nifi/blob/master/nifi-api/src/main/java/org/apache/nifi/provenance/ProvenanceReporter.java

      Attachments

        Issue Links

          Activity

            People

              m-hogue Michael Hogue
              Nissim Shiman Nissim Shiman
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 20m
                  3h 20m