Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-4971

ReportLineageToAtlas 'complete path' strategy can miss one-time lineages

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.5.0
    • Fix Version/s: 1.7.0
    • Component/s: Extensions
    • Labels:
      None

      Description

      For the simplest example, with GetFlowFIle (GFF) -> PutFlowFile (PFF), where GFF gets files and PFF saves those files into a different directory, then following provenance events will be generated:

      1. GFF RECEIVE file1
      2. PFF SEND file2

      From above provenance events, following entities and lineages should be created in Atlas, labels in brackets are Atlas type names:

      file1 (fs_path) -> GFF, PFF (nifi_flow_path) -> file2 (fs_path)
      

      Entities shown in above graph are created. However, the 'nifi_flow_path' entity do not have inputs/outputs referencing 'fs_path', so lineage can not be seen in Atlas UI.

      This issue was discovered by Mahesh Nayak

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ijokarumawak Koji Kawamura
                Reporter:
                ijokarumawak Koji Kawamura
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: