Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-2738

Export Process: Add Support for Incremental Export

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.8.3
    • Fix Version/s: 0.8.3
    • Component/s: atlas-core
    • Labels:
      None

      Description

      Background

      Use case: Export & Import process is used to synchronize data between clusters.

      Data is exported from a cluster and imported into another cluster. Subsequent exports should only contain entities that have been created or updated since the last export. This helps makes the export process quicker and the payload will be smaller.

      Implementation Approach

      Add new fetchTypeincremental, with additional parameter fromTime which is a timestamp. During Export process, entities' that have __modificationTimestamp greater than fromTime would be included in the export. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ashutoshm Ashutosh Mestry
                Reporter:
                ashutoshm Ashutosh Mestry
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated: