Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-8691

Retention period per process group / processor

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.13.2
    • Fix Version/s: None
    • Component/s: Extensions
    • Labels:
      None

      Description

      Today retention periods are set globally in the properites file.

       

      It's necessary to set retention periods per process group or individual processor.

       

      For some scenarios it's necessary to keep files and data for many years.

      For some scenarios it's necessary to delete files and data immediately.
      Everything in between the above.

      The reasons may be many like European GDPR law, tax regulations and laws, troubleshooting and many others.

       

      NiFi isn't an archiving and storage system of course 
      but for many scenarios it would make sense to have a fine control of the retention periods in NiFi.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              tomten1970 Jul Tomten
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: