[ATLAS-3183] Read Impala lineage record for creating view and send to Atlas

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Component/s: atlas-core
• Assignee: Na Li
• Reporter: Na Li
• Created: 01/May/19 20:07
• Updated: 09/May/19 06:25
• Resolved: 09/May/19 01:39

Description

Impala generates lineage records for its commands. This new feature will read Impala lineage file, convert the lineage record to Atlas entities and send them to Atlas. In this way, Atlas can get lineage of Impala operation.

The metadata referred in the lineage are captured in Hive Metastore hook and sent to Atlas. This work is done in ATLAS-3148

This jira only supports the Impala command "create view". Following jira will add support for more Impala commands.

Issue Links

• links to: pre-commit test
• links to: Review Link for this case