Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-3085

Provide an option in atlas to disable tracking of specified hive table entities and its lineages

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      When Atlas HiveHook is enabled, it captures DML statements such as inserts which in cases may not be required to capture, need a way to disable a functionality via configuration property.

      Steps to reproduce:

      CREATE TABLE test_hive_atlas
      (SSIN int,
      name string)
      CLUSTERED BY (SSIN) INTO 3 BUCKETS STORED AS ORC TBLPROPERTIES('transactional'='true');
      
      set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
      set hive.support.concurrency=true;
      set hive.enforce.bucketing=true;
      set hive.exec.dynamic.partition.mode=nonstrict;
      set hive.txn.strict.locking.mode=true;
      
      insert into test_hive_atlas(12398431, 'Name1');
      insert into test_hive_atlas values(342198432, 'Name2');

       

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              madhan Madhan Neethiraj
              Reporter:
              chiran54321 Chiran Ravani

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment