Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-7444

Add "retry" relation to the Convert Record Processor

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Configuration
    • Labels:
      None

      Description

      Follows the case for adding a retry relationship and redirect the "failed" conversion to this relationship in certain scenarios with one of those discussed below.

      Today we have either success or failure relationship for ConvertRecord processor. It works well until the Record Reader/Writer is using Schema Registry and then we reach a point where Schema Registry is unavailable due to any reason. Now the records which are supposed to be converted from one format to another are routed to failure because “schema” is not found for those flow files.

      One can re-attempt those flow files in one way or another but the issue is it’s not effective to retry a flow file any number of times which doesn’t have a schema available, actually. On the flip side, we can have a counter that the flow file should be tried n number of times before being redirected to the failure relationship but then again we are on the mercy of Schema Registry to be up within the configured period of re-attempts before we potentially "lose" the flow file by redirecting it to the failed relationship.

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              rsoni Rahul Soni
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: