[NIFI-8030] Improve Atlas lineage when using PutHDFS to push data accessed through Hive

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Component/s: Extensions
• Assignee: Peter Turcsanyi
• Reporter: Pierre Villard
• Created: 19/Nov/20 15:34
• Updated: 25/Feb/21 14:38
• Resolved: 25/Feb/21 14:38

Description

PutHDFS logs individual HDFS file entities to Atlas (not the containing directory), but Hive expects the directory. So it is not possible to join lineages in Atlas currently. This JIRA is about improving this situation.

Issue Links

• links to: GitHub Pull Request #4813