Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-13436

MiNiFi C2 Flow update - Queue is dropped even component exists in the proposed flow

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.0.0-M3
    • 2.0.0-M5
    • MiNiFi

    Description

      Issue

      When we propose a new flow for a running MiNiFi instance it first stop the source processors and try to wait until a pre-defined graceful period to have empty queues. If remaining items are in the queues after this period, the given flowfiles are dropped.

      This behaviour may cause data loss if the proposed flow contains some existing components.

      Proposed solution

      After the graceful period expires, we should drop flowfiles only from those queues, that don't exist in the proposed flow.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ferdei Ferenc Erdei
            ferdei Ferenc Erdei
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 10m
                10m

                Slack

                  Issue deployment