[ATLAS-4734] HiveProcess - Output entity creation is ignored in case of same entity exists both inputs and outputs from context

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0, 2.4.0
• Component/s: atlas-core
• Assignee: Radhika Kundam
• Reporter: Radhika Kundam
• Created: 13/Mar/23 23:00
• Updated: 28/Mar/23 17:59
• Resolved: 27/Mar/23 21:45

Description

Lineage is not generated while using INSERT OVERWRITE with UNION and LEFT JOIN.

INSERT OVERWRITE TABLE tblB SELECT id, name, email FROM tblA UNION SELECT B.id, B.name, B.email FROM tblB B LEFT JOIN tblA A ON B.id=A.id; 

In this scenario Hive context will be sending inputs as tblA & tblB and outputs as tblB.

While processing these inputs and outputs since tblB is already processed as part of inputs, it's getting ignored while processing as part of outputs. Because of that hive_process entity is missing outputs entity details.

Issue Links

• links to: ReviewBorad request