Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-492

Hive Hook Improvements

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: 0.7-incubating
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Requirements:

      • Support ALTER statements (add/replace/rename cols)
      • Support DROP statements ( support drop database, table, view)
      • Support LOAD statements
      • Remodelling changes

        Attachments

        Issue Links

        1.
        Support Alter Table column commands Sub-task Resolved Suma Shivaprasad Actions
        2.
        Support Alter table commands Sub-task Resolved Suma Shivaprasad Actions
        3.
        Support alter view Sub-task Resolved Suma Shivaprasad Actions
        4.
        Support alter database Sub-task Resolved Suma Shivaprasad Actions
        5.
        Drop support for partitions, select query lineage, roles, principals, resource, hive_type... Sub-task Resolved Suma Shivaprasad Actions
        6.
        Verify insert into select results in table lineage Sub-task Resolved Suma Shivaprasad Actions
        7.
        Support lineage for load table, import, export Sub-task Resolved Suma Shivaprasad Actions
        8.
        support drop table, view Sub-task Resolved Suma Shivaprasad Actions
        9.
        support drop database Sub-task Resolved Suma Shivaprasad Actions
        10.
        Add table information to column class Sub-task Resolved Suma Shivaprasad Actions
        11.
        Remove isComposite on storageDescriptor.cols Sub-task Resolved Suma Shivaprasad Actions
        12.
        Change Data types of all timestamps in Hive model(currently long) Sub-task Resolved Suma Shivaprasad Actions
        13.
        Support drop database with cascade Sub-task Resolved Unassigned Actions
        14.
        Verify free text search is able to surface search on table parameters Sub-task Resolved Suma Shivaprasad Actions
        15.
        Support delete cascade efficiently Sub-task Resolved Unassigned Actions
        16.
        Make qualifiedName and name consistent across all Datasets and Process Sub-task Resolved Suma Shivaprasad Actions
        17.
        alter table rename should modify the list of columns and storage descriptor Sub-task Resolved Suma Shivaprasad Actions
        18.
        Parallelize Hive hook operations Sub-task Open Unassigned Actions
        19.
        Rename table should retain traits/tags assigned to columns/storage descriptors Sub-task Resolved Suma Shivaprasad Actions
        20.
        alter table rename doesnt work across databases Sub-task Resolved Suma Shivaprasad Actions
        21.
        'Description/Comment' attribute needs to be normalized hive_db, hive_table Sub-task Resolved Unassigned Actions
        22.
        Handle Cluster renaming Sub-task Open Unassigned Actions
        23.
        Change from Hive thrift interface to Hive MetastoreClient Sub-task Resolved Suma Shivaprasad Actions
        24.
        import-hive should create the lineage for external tables Sub-task Resolved Vimal Sharma Actions
        25.
        Truncate table, insert into local dir, load from local dir , update, delete commands should be easily trackable from a table Sub-task Open Unassigned Actions
        26.
        ALTER TABLE TOUCH is not modelled Sub-task Open Unassigned Actions
        27.
        "ALTER TABLE .. NOT STORED AS DIRECTORIES" metadata update is not sent to Atlas. Sub-task Open Unassigned Actions
        28.
        insert into local dir, load from local dir does not show up in lineage Sub-task Resolved Unassigned Actions

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              bergenholtz Erik Bergenholtz

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment