[RANGER-3323] Ranger Hive Table lookup is not working.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0, 2.2.0
• Component/s: Ranger
• Assignee: Nitin Galave
• Reporter: Nitin Galave
• Created: 25/Jun/21 10:31
• Updated: 15/Jul/21 13:41
• Resolved: 28/Jun/21 13:20

Description

Ranger Hive table lookup is failing with the below error message.

2021-06-23 09:13:36,206 INFO  org.apache.hadoop.hive.metastore.thrift.TCustomSocket: [main]: Buffer size for TSocket is: 8192
2021-06-23 09:13:36,211 INFO  org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-10-thread-74]: 51: get_multi_table : db={ tbls=null
2021-06-23 09:13:36,211 INFO  org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-10-thread-74]: ugi=rangerlookup/[e-mail]	ip=172.27.28.139	cmd=get_multi_table : db={ tbls=null	
2021-06-23 09:13:36,212 INFO  org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-10-thread-74]: 51: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-06-23 09:13:36,213 INFO  org.apache.hadoop.hive.metastore.ObjectStore: [pool-10-thread-74]: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@619f1981, with PersistenceManager: null will be shutdown
2021-06-23 09:13:36,214 INFO  org.apache.hadoop.hive.metastore.ObjectStore: [pool-10-thread-74]: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@619f1981, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@60bbf86c created in the thread with id: 292
2021-06-23 09:13:36,216 INFO  org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-10-thread-74]: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@619f1981 from thread id: 292
2021-06-23 09:13:36,219 WARN  org.apache.hadoop.hive.metastore.ObjectStore: [pool-10-thread-74]: Failed to get database hive.{, returning NoSuchObjectException
2021-06-23 09:13:36,219 ERROR org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-10-thread-74]: UnknownDBException(message:Could not find database hive.{: {)
	at org.apache.hadoop.hive.metastore.ObjectStore.getTableObjectsByName(ObjectStore.java:2255)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
	at com.sun.proxy.$Proxy32.getTableObjectsByName(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getTableObjectsInternal(HiveMetaStore.java:3773)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_objects_by_name_req(HiveMetaStore.java:3740)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:160)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:121)
	at com.sun.proxy.$Proxy41.get_table_objects_by_name_req(Unknown Source)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_table_objects_by_name_req.getResult(ThriftHiveMetastore.java:18454)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_table_objects_by_name_req.getResult(ThriftHiveMetastore.java:18438)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
	at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
	at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
	at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:638)
	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2021-06-23 09:13:37,139 INFO  org.apache.hadoop.hive.ql.txn.compactor.Cleaner: [Thread-14]: Cleaning based on min open txn id: 10
2021-06-23 09:13:42,139 INFO  org.apache.hadoop.hive.ql.txn.compactor.Cleaner: [Thread-14]: Cleaning based on min open txn id: 10
2021-06-23 09:13:47,139 INFO  org.apache.hadoop.hive.ql.txn.compactor.Cleaner: [Thread-14]: Cleaning based on min open txn id: 10
2021-06-23 09:13:52,139 INFO  org.apache.hadoop.hive.ql.txn.compactor.Cleaner: [Thread-14]: Cleaning based on min open txn id: 10
2021-06-23 09:13:57,140 INFO  org.apache.hadoop.hive.ql.txn.compactor.Cleaner: [Thread-14]: Cleaning based on min open txn id: 10
2021-06-23 09:14:02,141 INFO  org.apache.hadoop.hive.ql.txn.compactor.Cleaner: [Thread-14]: Cleaning based on min open txn id: 10
2021-06-23 09:14:02,528 INFO  org.apache.hadoop.hive.metastore.txn.AcidOpenTxnsCounterService: [pool-13-thread-7]: Open txn counter ran for 0 seconds. isAliveCounter: 3351
2021-06-23 09:14:07

Issue Links

• links to: Apache Review Request.