Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-751

Add support for primary key constraint on class types

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.7-incubating
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Persisting the qualified Name for an entity has multiple issues

      1. In case of soft deletes,consider the following scenario

      a. Table A -> insert overwrite -> Table B

      If the table A and B are dropped and recreated again and the insert overwrite query is rerun, then it should create another lineage process since the tables are different here. Similarly for CTAS etc. However the same process will get updated due to the current way of storing qualifiedName

      2. Storing qualified names inherently leads to a lot of updates during operations renames for eg: if a table is renames, all its columns.qualifiedName, sd.qualifiedName etc get updated. If this is done with partitions, then the updates will definitely take a lot of time.

        Attachments

        1. ATLAS-751.1.patch
          156 kB
          Suma Shivaprasad
        2. ATLAS-751.1.patch
          367 kB
          Suma Shivaprasad

          Activity

            People

            • Assignee:
              suma.shivaprasad Suma Shivaprasad
              Reporter:
              suma.shivaprasad Suma Shivaprasad
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: