[NIFI-9764] Atlas reporting task should not send Hive database lineage

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.16.0
• Component/s: Extensions
• Assignee: Peter Turcsanyi
• Reporter: Peter Turcsanyi
• Created: 04/Mar/22 20:34
• Updated: 10/Mar/22 12:17
• Resolved: 10/Mar/22 12:17

Description

Hive table name may not be available in the provenance repository in some cases (https://github.com/apache/nifi/blob/65dd62716a62164f44be85657283103885f0f3ae/nifi-nar-bundles/nifi-hive-bundle/nifi-hive3-processors/src/main/java/org/apache/nifi/processors/hive/PutHive3QL.java#L247-L252).
In this case, the Atlas reporting task sends database lineage (hive_db entity without hive_table) to Atlas but hive_db is not a DataSet entity and therefore it cannot be used in a lineage directly.

Send hive_table with name 'unknown' when table name info is not available.

Issue Links

• links to: GitHub Pull Request #5839