[ATLAS-2873] Atlas Import Transform Handler Implementation

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.3
• Fix Version/s: 0.8.3, 1.2.0, 2.0.0
• Component/s: atlas-core
• Assignee: Sarath Subramanian
• Reporter: Sarath Subramanian
• Created: 16/Sep/18 19:45
• Updated: 26/Sep/19 00:38
• Resolved: 17/Sep/18 13:52

Description

Implement atlas entity transformation during import.

 

e.g.

Condition Operators : EQUALS, STARTS_WITH

Action Operators       : SET, TO_LOWER, TO_UPPER, REPLACE_PREFIX

 

Condition :  "hdfs_path.clusterName", "EQUALS: cl1"

Action       :  "hdfs_path.clusterName", "SET: cl2"

 

Condition :  "hdfs_path.clusterName", "EQUALS: cl1"

Action       :  " hdfs_path.clusterName", "TO_UPPER:"

 

Condition :  " hdfs_path.clusterName", "EQUALS: CL1"

Action       :  " hdfs_path.clusterName", "TO_LOWER:" 

 

Condition :  " hdfs_path.name", "STARTS_WITH: /aa/bb/"

Action       :  " hdfs_path.name", "REPLACE_PREFIX: = :/aa/bb/=/xx/yy/"

 

Condition :  "hive_db.clusterName", "EQUALS: cl1"
Action       :  "hive_db.clusterName", "SET: cl1_backup; 

 

Condition :  "hive_db.name", "EQUALS: hr"
Action       :  "hive_db.name", "SET: hr_backup"

 

Condition :  "hive_table.name", "EQUALS: employees"
Action       :  "hive_table.name", "SET: employees_backup"

 

Condition :  "hive_column.name", "EQUALS: age"
Action       :  "hive_column.name", "SET: age_backup"

Issue Links

• is a parent of: ATLAS-2874 Include handling of Atlas Entity Transformers in current Import logic