Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-3792

A processor to facilitate retrying FlowFiles

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      When dealing with processor failures in production, potentially related to network issues, the current best practice is to retry the flowfile a couple times before declaring it a failure[1]. This currently requires multiple processors and penalizing the flowfile isn't possible. Also if the flow is not fast enough, back-pressure can cause a livelocked state which requires manual intervention.

      A new processor should be added to not only encourage best practices but also offer configuration options to deal with un-optimal situations.

      [1] https://community.hortonworks.com/questions/77336/nifi-best-practices-for-error-handling.html

      Attachments

        Activity

          People

            jpercivall Joe Percivall
            jpercivall Joe Percivall
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m