[ATLAS-2864] Export Process: Incremental: Improve Approach for Fetching Changed Entities

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.2
• Fix Version/s: 0.8.3, 1.2.0, 2.0.0
• Component/s: atlas-core
• Assignee: Ashutosh Mestry
• Reporter: Ashutosh Mestry
• Due: 14/Sep/18
• Created: 10/Sep/18 20:41
• Updated: 26/Sep/19 00:38
• Resolved: 14/Sep/18 05:02

Description

Background

Existing approach for getting modified entities tends to iterate through the entire set of entities and then filter. This results in no benefit in terms of time and effort for incremental export. It does benefit Import, where smaller set is imported.

Approach

• User Gremlin queries to fetch entities that match criteria.
• Modify existing logic that does deep traversal to support this new logic.