[ATLAS-4098] Add location relationship attribute for hive_db

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 3.0.0, 2.2.0
• Component/s: atlas-core
• Labels: hive-hooks model
• Assignee: Radhika Kundam
• Reporter: Radhika Kundam
• Created: 11/Jan/21 19:26
• Updated: 08/Feb/21 05:44
• Resolved: 08/Feb/21 05:44

Description

Requirement is to add "location" as one of the relationships to hive_db. With this we can create a "location" entity based on the type of file storage and assign it to hive_db relationship attributes.

Since we are creating entities for location we can get more details about the path. To support location entity with all types of file storage, need to create a super type for all types of location entities.

For that purpose, introduce new layer between DataSet and other location entities which are derived from DataSet. Create "Path" entity which should be derived from "DataSet" entity and "Path" should be a super type of all other location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities which will be subtypes of "Path" entity.

This location relationship attribute should be created with endDef1 as "hive_db" and endDef2 as "Path".

Issue Links

• links to: Code Review