[ATLAS-3563] Improve tag propagation performance using in-memory traversal

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.1.0
• Component/s: atlas-core
• Assignee: Sarath Subramanian
• Reporter: Sarath Subramanian
• Created: 17/Dec/19 08:26
• Updated: 23/Dec/19 15:17
• Resolved: 18/Dec/19 04:24

Description

Tag propagation uses gremlin query to find entities to which the tag has to be propagated to.

Gremlin query doesn't scale well for entities with large lineage (with many depth). In-memory traversal seems to have improved performance significantly since it avoids the overhead added by gremlin script engine initialization, query execution time.

Performance improvement in tag propagation from 3004 ms to 180 ms is seen

Issue Links

• links to: Code review
• links to: Precommit