[ATLAS-3595] Data Migration: Support zip file for data migration

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: trunk
• Assignee: Nikhil P Bonte
• Reporter: Nikhil P Bonte
• Created: 24/Jan/20 13:25
• Updated: 17/Feb/20 05:46
• Resolved: 17/Feb/20 05:30

Description

Data migration service added under ATLAS-2461 works with json files as input.

This improvement will enable Data Migration service to import data using a zip file.

Approach:

• Property value for migration should contain full path of file, below is the example. 
• Data migration service will first check migration property if value refers to a zip file.
• If true, it will call ZipMigrationImporter to import data in zip file.
• ZipMigrationImporter internally uses existing ImportService to ingest zip.
• Audit service & Notification service will also be started as a part of zip import.

E.g. properties to enable zip data migration:

• atlas.migration.data.filename=/path/fileName.zip
  atlas.migration.mode.workers=5
  atlas.migration.mode.batch.size=20

Issue Links

• incorporates: ATLAS-3603 Data Migration: Auto-start zip Migration Import
• links to: Review request