Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-3085

Provide an option in atlas to disable tracking of specified hive table entities and its lineages

    XMLWordPrintableJSON

    Details

      Description

      When Atlas HiveHook is enabled, it captures DML statements such as inserts which in cases may not be required to capture, need a way to disable a functionality via configuration property.

      Steps to reproduce:

      CREATE TABLE test_hive_atlas
      (SSIN int,
      name string)
      CLUSTERED BY (SSIN) INTO 3 BUCKETS STORED AS ORC TBLPROPERTIES('transactional'='true');
      
      set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
      set hive.support.concurrency=true;
      set hive.enforce.bucketing=true;
      set hive.exec.dynamic.partition.mode=nonstrict;
      set hive.txn.strict.locking.mode=true;
      
      insert into test_hive_atlas(12398431, 'Name1');
      insert into test_hive_atlas values(342198432, 'Name2');

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                madhan Madhan Neethiraj
                Reporter:
                chiran54321 Chiran Ravani
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: