[HIVE-22799] HiveMetaStoreAuthorizer parses conf on every HMS invocation

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Component/s: Metastore
• Assignee: Unassigned
• Reporter: Rajesh Balamohan
• Created: 31/Jan/20 09:22
• Updated: 18/Mar/21 01:49
• Resolved: 18/Mar/21 01:49

Description

Stacktrace may not match exactly master  branch. But in master as well, it is not very different.

at org.apache.hadoop.util.StringInterner.weakIntern(StringInterner.java:71)
	at org.apache.hadoop.conf.Configuration$Parser.handleEndElement(Configuration.java:3273)
	at org.apache.hadoop.conf.Configuration$Parser.parseNext(Configuration.java:3354)
	at org.apache.hadoop.conf.Configuration$Parser.parse(Configuration.java:3137)
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3030)
	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2991)
	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2871)
	- locked <0x00000005cbe60ad0> (a org.apache.hadoop.mapred.JobConf)
	at org.apache.hadoop.conf.Configuration.set(Configuration.java:1389)
	at org.apache.hadoop.conf.Configuration.set(Configuration.java:1361)
	at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:518)
	at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:536)
	at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:430)
	at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:5482)
	at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:5450)
	at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.createHiveMetaStoreAuthorizer(HiveMetaStoreAuthorizer.java:450)
	at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.onEvent(HiveMetaStoreAuthorizer.java:100)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:3835)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_database_req(HiveMetaStore.java:1655)
	at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
	at com.sun.proxy.$Proxy28.get_database_req(Unknown Source)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_database_req.getResult(ThriftHiveMetastore.java:15671)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_database_req.getResult(ThriftHiveMetastore.java:15655)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)

Issue Links

• is duplicated by: HIVE-24022 Optimise HiveMetaStoreAuthorizer.createHiveMetaStoreAuthorizer