[ATLAS-2909] Export Process: ChangeMarker Remains Stuck at a Point

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.2
• Fix Version/s: 0.8.2, 0.8.3, 1.2.0, 2.0.0
• Component/s: atlas-core
• Assignee: Ashutosh Mestry
• Reporter: Ashutosh Mestry
• Created: 07/Oct/18 22:53
• Updated: 26/Sep/19 00:39
• Resolved: 16/Oct/18 23:49

Description

Pre-requisites

• Fresh installation of a build. This can be done by truncating atlas_titan and ATLAS_ENTITY_AUDIT_EVENTS tables.
• Create some entities within Atlas either by 'Create New Entity' UI option or via Beeline/Hive.

Steps to Duplicate

• Perform export few times (more than 1) of the created entities using the following options and commands.
• Observe the server logs (application.log)

export-options.json

{
    "itemsToExport": [
        { "typeName": "hdfs_path", "uniqueAttributes": { "path": "/warehouse/hr/" }}
    ],
    "options": {
        "fetchType": "incremental",
        "matchType": "startsWith",
        "skipLineage": true,
        "replicatedTo": "clMain2"
    }
}

CURL

curl -X POST -u admin:admin -H "Content-Type: application/json" -H "Cache-Control: no-cache" -d @../docs/export-options-skip-lineage.json http://localhost:21000/api/atlas/admin/export > ../docs/hr-1.zip

 

Expected Results

Each export operation will display changeMarker with new value.

Observed Results

Each export operation displays the same changeMarker value.

Variation

Restart Atlas. Perform few exports. The value of changeMarker now changes for each export.