Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
在AWS EMR5.33版本中，连接AWS Glue时，报无法连接错误，在kylin3中使用是ok的。信息如下：
2021-11-23 02:35:05,254 ERROR [pool-5-thread-1] metadata.Hive : Unable to instantiate a metastore client factory com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory due to: java.lang.ClassNotFoundException: Class com.amazonaws.glue.catalog.metastore .AWSGlueDataCatalogHiveClientFactory not found java.lang.ClassNotFoundException: Class com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2273 ) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClientFactory(Hive.java:3015 ) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3006 )
另一个日志如下：
2021-11-25 07:07:57,025 ERROR [http-bio-7070-exec-5] controller.TableController:200 : Unable to create M etaStoreClient for gluecatalog java.lang.IllegalStateException: Unable to create MetaStoreClient for gluecatalog at org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreC lientFactory.java:55 ) at org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:164 ) at org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:118 ) at org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:51 ) at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:274 ) at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:198 ) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62 ) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43 ) at java.lang.reflect.Method.invoke(Method.java:498 ) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod .java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandl erMethod.java:133 ) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAnd Handle(ServletInvocableHandlerMethod.java:97 ) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHand lerMethod(RequestMappingHandlerAdapter.java:854 ) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInte rnal(RequestMappingHandlerAdapter.java:765 ) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandle rMethodAdapter.java:85 ) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967 ) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901 ) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970 ) at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861 ) at javax.servlet.http.HttpServlet.service(HttpServlet.java:621 ) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846 ) at javax.servlet.http.HttpServlet.service(HttpServlet.java:728 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java : 303) ..... at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run ([JIoEndpoint.java:317 |http://jioendpoint.java:317/]) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149 ) at java.util.concurrent.ThreadPoolExecutor$Worker.run ([ThreadPoolExecutor.java:624 |http://threadpoolexecutor.java:624/]) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run ([TaskThread.java:61 |http://taskthread.java:61/]) at java.lang.Thread.run ([Thread.java:748 |http://thread.java:748/]) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62 ) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43 ) at java.lang.reflect.Method.invoke(Method.java:498 ) at org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreC lientFactory.java:53 ) ... 81 more Caused by: com.google.common.util.concurrent.ExecutionError: java.lang.NoSuchFieldError: INSTANCE at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2261 ) at com.google.common.cache.LocalCache.get(LocalCache.java:4000 ) at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4789 ) at org.apache.hive.hcatalog.common.HiveClientCache.getOrCreate(HiveClientCache.java:316 ) at org.apache.hive.hcatalog.common.HiveClientCache.get(HiveClientCache.java:278 ) at org.apache.hive.hcatalog.common.HCatUtil.getHiveMetastoreClient(HCatUtil.java:558 ) ... 86 more Caused by: java.lang.NoSuchFieldError: INSTANCE at org.apache.http.conn.ssl.SSLConnectionSocketFactory.<clinit>(SSLConnectionSocketFactory.java : 151) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.getPreferredSocketFactor y(ApacheConnectionManagerFactory.java:89 ) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.create(ApacheConnectionM anagerFactory.java:66 ) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.create(ApacheConnectionM anagerFactory.java:59 ) at com.amazonaws.http.apache.client.impl.ApacheHttpClientFactory.create(ApacheHttpClientFactory. java:50) at com.amazonaws.http.apache.client.impl.ApacheHttpClientFactory.create(ApacheHttpClientFactory. java:38)