[ATLAS-3085] Provide an option in atlas to disable tracking of specified hive table entities and its lineages

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Resolved
• Affects Version/s: 1.1.0
• Fix Version/s: 0.8.4, 1.2.0, 2.0.0
• Component/s: atlas-core
• Labels: no-release-note
• Assignee: Madhan Neethiraj
• Reporter: Chiran Ravani
• Created: 20/Mar/19 13:26
• Updated: 25/Sep/19 19:07
• Resolved: 21/Mar/19 23:02

Description

When Atlas HiveHook is enabled, it captures DML statements such as inserts which in cases may not be required to capture, need a way to disable a functionality via configuration property.

Steps to reproduce:

CREATE TABLE test_hive_atlas
(SSIN int,
name string)
CLUSTERED BY (SSIN) INTO 3 BUCKETS STORED AS ORC TBLPROPERTIES('transactional'='true');

set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
set hive.support.concurrency=true;
set hive.enforce.bucketing=true;
set hive.exec.dynamic.partition.mode=nonstrict;
set hive.txn.strict.locking.mode=true;

insert into test_hive_atlas(12398431, 'Name1');
insert into test_hive_atlas values(342198432, 'Name2');

 

Issue Links

• Is contained by: ATLAS-3006 Option to ignore/prune metadata for temporary/staging Hive tables