[ATLAS-1512] Hive Hook fails due to - Table not found exception

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Information Provided
• Component/s: atlas-core, atlas-intg
• Environment: newly built, and configured Apache Atlas .7.1rc3; BigInsights 4.2.0.0 -; ; The example worked fine using Apache Atlas .7.0rc2
• Assignee: Unassigned
• Reporter: Russell Anderson
• Created: 31/Jan/17 19:31
• Updated: 29/Jun/17 10:39
• Resolved: 29/Jun/17 10:39

Description

After configuring Hive Hook: Ran the following Hive SQL command:
Create table sysibm.sparktest as select * from sysibm.sparktable;

-the table sysibm.sparktable exists
-the table system.sparktest is getting created as a result of this command.
-the table gets successfully created within the schema sysibm but the Hive Hook does is not able deal with this correctly.

2017-01-31 07:49:56,979 INFO metastore.HiveMetaStore (HiveMetaStore.java:logIn\
fo(746)) - 6: get_table : db=sysibm tbl=sparktest
2017-01-31 07:49:56,980 INFO HiveMetaStore.audit (HiveMetaStore.java:logAuditE\
vent(371)) - ugi=hive ip=unknown-ip-addr cmd=get_table : db=sysibm tbl=\
sparktest
2017-01-31 07:49:56,984 ERROR metadata.Hive (Hive.java:getTable(1119)) - Table \
sparktest not found: sysibm.sparktest table not found
2017-01-31 07:49:56,984 ERROR hook.HiveHook (HiveHook.java:run(207)) - Atlas ho\
ok failed due to error
java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInform\
ation.java:1672)
at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:197)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:5\
11)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor\
.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecuto\
r.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not \
found sparktest
at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1120)
at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1090)
at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.\
java:559)
at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.\
java:581)
at org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:\
669)
at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:64\
9)
at org.apache.atlas.hive.hook.HiveHook.collect(HiveHook.java:270)
at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:85)
at org.apache.atlas.hive.hook.HiveHook$2$1.run(HiveHook.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInform\
ation.java:1657)
... 6 more
2017-01-31 07:49:57,029 INFO log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) \