Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-7263

Add a No tracking Strategy to ListFile/ListFTP

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.13.0
    • Extensions

    Description

      The Listfile/ListFTP has 2 Listing Strategies: Tracking Timestamps and Tracking Entities.

      It would be very very nice if the List process also could have a No Tracking (fix it your self) strategy

      If running NIFI in a cluster the List/Fetch is the perfect solution instead of using a GetFile. But we have had many caces where files in the pickup folder has old timestamps, so here we have to use Tracking Entities.
      The issue is in cases where you are not allowed to delete files but you have to make a change to the file filter. The tracking entities start all over, and list all files again.

      In other situations we need to resent all data, and would like to clear the state of the Tracking Entities. But you can't.

      So I have to make a small flow for detecting duplicates. And in some cases just ignore duplicates and in other caces open up for sending duplicates. But it is a pain in the ... to use the Tracking Entities.

      So a NO STRATEGY would be very very nice

      Attachments

        Activity

          People

            waibani Waleed Al Aibani
            jmkofoed Jens M Kofoed
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 2h 10m
                2h 10m