Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-7009

Deleted flow components should not be queried by Atlas reporting task

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.11.0
    • Component/s: None
    • Labels:
      None

      Description

      The NiFi Atlas reporting task retrieves the flow and its components from Atlas at every execution of the task in the following way:

      1. get flow
      2. get each flow component
      3. filter out deleted components

      #1 returns references to all the subcomponents of the flow, also to the deleted ones. It seems there is no way to parameterize the Atlas query to filter out the deleted item here.

      But the result of #1 already contains the status of the components, so the deleted items do not need to be queried in #2, then filter out in #3 only.

      #2 and #3 can be swapped, and only the active items need to be retrieved.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                turcsanyip Peter Turcsanyi
                Reporter:
                turcsanyip Peter Turcsanyi
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h