Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-751

Add support for primary key constraint on class types

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7-incubating
    • 2.0.0
    • None
    • None

    Description

      Persisting the qualified Name for an entity has multiple issues

      1. In case of soft deletes,consider the following scenario

      a. Table A -> insert overwrite -> Table B

      If the table A and B are dropped and recreated again and the insert overwrite query is rerun, then it should create another lineage process since the tables are different here. Similarly for CTAS etc. However the same process will get updated due to the current way of storing qualifiedName

      2. Storing qualified names inherently leads to a lot of updates during operations renames for eg: if a table is renames, all its columns.qualifiedName, sd.qualifiedName etc get updated. If this is done with partitions, then the updates will definitely take a lot of time.

      Attachments

        1. ATLAS-751.1.patch
          156 kB
          Suma Shivaprasad
        2. ATLAS-751.1.patch
          367 kB
          Suma Shivaprasad

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            suma.shivaprasad Suma Shivaprasad
            suma.shivaprasad Suma Shivaprasad
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment