Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-2760

Update Hive hook to create AWS S3 entities for S3 path references

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.1.0, 2.0.0
    • atlas-intg
    • None

    Description

      Entity types for AWS S3 have been added recently via ATLAS-2708. Hive hook should be updated to create AWS S3 entities for references to S3 paths - for example in 'insert overwrite' operation. This will capture the lineage between Hive tables and S3 paths.

      Attachments

        1. ATLAS-2760-2.patch
          8 kB
          Madhan Neethiraj

        Activity

          People

            madhan Madhan Neethiraj
            madhan Madhan Neethiraj
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: