Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-1503

Export/import support to copy data between Atlas instances

    Details

      Description

      One of the often asked feature is the ability to export data stored in Atlas (entity, lineage, tag-association, types) and import the exported data into another Atlas instance. This feature should support the ability to export specified list of objects, along with their associated objects, tags and type. For example, if a hive_db named "finance" is specified, export should include the following:

      • hive_db entity along with its tags
      • all tables in this database and their tags
      • all columns in above tables and their tags
      • the lineage information associated with above entities
      • type-defintion of all above entities

      During import, if an exported entity is not present in the target Atlas, it should be created. If the entity already exists at the target (by guid or by unique attribute value), the entity should be updated.

      1. ATLAS-1503.2.patch
        50 kB
        Ashutosh Mestry
      2. ATLAS-1503.7.patch
        19 kB
        Madhan Neethiraj
      3. ATLAS-1503-Import.2.patch
        42 kB
        Ashutosh Mestry
      4. ATLAS-1503-Import-Optimized.patch
        35 kB
        Ashutosh Mestry
      5. ATLAS-1630.4.patch
        2 kB
        Madhan Neethiraj

        Issue Links

          Activity

          Hide
          ashutoshm Ashutosh Mestry added a comment -
          Show
          ashutoshm Ashutosh Mestry added a comment - Patch available at: https://reviews.apache.org/r/56311/
          Hide
          ashutoshm Ashutosh Mestry added a comment -
          Show
          ashutoshm Ashutosh Mestry added a comment - New patch for review: https://reviews.apache.org/r/56518/
          Hide
          ashutoshm Ashutosh Mestry added a comment -

          Includes optimized import and improved metrics.

          Show
          ashutoshm Ashutosh Mestry added a comment - Includes optimized import and improved metrics.
          Hide
          madhan.neethiraj Madhan Neethiraj added a comment - Reporter

          +1 for the patch. Thanks Ashutosh Mestry.

          Show
          madhan.neethiraj Madhan Neethiraj added a comment - Reporter +1 for the patch. Thanks Ashutosh Mestry .
          Hide
          madhan.neethiraj Madhan Neethiraj added a comment - Reporter

          Patch with export enhancements to specify objects-to-export using attribute value - like hdfs_path.name startsWith/contains/endsWith a given path. Thanks Ashutosh Mestry.

          Show
          madhan.neethiraj Madhan Neethiraj added a comment - Reporter Patch with export enhancements to specify objects-to-export using attribute value - like hdfs_path.name startsWith/contains/endsWith a given path. Thanks Ashutosh Mestry .
          Hide
          madhan.neethiraj Madhan Neethiraj added a comment - Reporter
          Show
          madhan.neethiraj Madhan Neethiraj added a comment - Reporter Committed to master: http://git-wip-us.apache.org/repos/asf/incubator-atlas/commit/515130cc
          Hide
          madhan.neethiraj Madhan Neethiraj added a comment - Reporter
          Show
          madhan.neethiraj Madhan Neethiraj added a comment - Reporter Review board URL: https://reviews.apache.org/r/57495/

            People

            • Assignee:
              ashutoshm Ashutosh Mestry
              Reporter:
              madhan.neethiraj Madhan Neethiraj
              Request participants:
              None
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: