Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5977

Add "Minimum/Maximum File Age" Parameter to ListSFTP

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.8.0
    • Fix Version/s: 1.10.0, 1.9.1
    • Component/s: Extensions
    • Labels:
      None

      Description

      Please add the following two parameter to the ListSFTP processor.

      • Minimum File Age
      • Maximum File Age

      The ListFile processor has these parameters already. 

      Without this parameters we have the issue that big continuously written files get processed multiple times and we have to filter out somehow duplicates later together with a wait processor. ListSFTP is highly dependent on the last modified timestamp and this is a crucial feature for us as we have no control over the remote servers - so workarounds like to a starting "." aren't possible.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                aboda Arpad Boda
                Reporter:
                jzahner Josef Zahner
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m