[IMPALA-9097] Some backend tests fail if the Hive Metastore is not running

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.4.0
• Fix Version/s: Impala 4.0.0
• Component/s: Frontend
• Target Version: Impala 4.0.0
• Epic Color: ghx-label-5
• Assignee: Joe McDonnell
• Reporter: Joe McDonnell
• Created: 25/Oct/19 23:49
• Updated: 28/Apr/20 16:49
• Resolved: 28/Apr/20 16:49

Description

In our docker-based tests (i.e. docker/test_with_docker.py), we run the backend tests without starting a minicluster. This is now failing due to a new dependency on the Hive Metastore. This applies to a bunch of tests, which all fail with this error:

F0917 00:37:47.849447  7660 frontend.cc:134] IllegalStateException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClientF0917 
00:37:47.849447  7660 frontend.cc:134] IllegalStateException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
CAUSED BY: RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
CAUSED BY: InvocationTargetException: null
CAUSED BY: MetaException: Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
 at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
 at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:545)
 at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:303)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
 at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1773)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:80)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:130)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:101)
 at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:94)
 at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:99)
 at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:78)
 at org.apache.impala.catalog.MetaStoreClientPool.initClients(MetaStoreClientPool.java:174)
 at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:163)
 at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:155)
 at org.apache.impala.service.Frontend.<init>(Frontend.java:301)
 at org.apache.impala.service.Frontend.<init>(Frontend.java:270)
 at org.apache.impala.service.JniFrontend.<init>(JniFrontend.java:141)

The list of tests that currently fail in this configuration are:

 

2019-10-25 14:21:36.059346 The following tests FAILED:
2019-10-25 14:21:36.059378 	  3 - llvm-codegen-test (Child aborted)
2019-10-25 14:21:36.059404 	  8 - hash-table-test (Failed)
2019-10-25 14:21:36.059436 	 11 - row-batch-list-test (Child aborted)
2019-10-25 14:21:36.059468 	 19 - hdfs-parquet-scanner-test (Failed)
2019-10-25 14:21:36.059491 	 20 - expr-test (Failed)
2019-10-25 14:21:36.059521 	 21 - expr-codegen-test (Child aborted)
2019-10-25 14:21:36.059551 	 28 - data-stream-test (Child aborted)
2019-10-25 14:21:36.059586 	 39 - buffered-tuple-stream-test (Child aborted)
2019-10-25 14:21:36.059613 	 41 - tmp-file-mgr-test (Failed)
2019-10-25 14:21:36.059644 	 42 - row-batch-serialize-test (Failed)
2019-10-25 14:21:36.059673 	 43 - row-batch-test (Child aborted)
2019-10-25 14:21:36.059710 	 44 - collection-value-builder-test (Child aborted)
2019-10-25 14:21:36.059741 	 45 - runtime-state-test (Child aborted)
2019-10-25 14:21:36.059774 	 46 - buffer-allocator-test (Child aborted)
2019-10-25 14:21:36.059804 	 47 - buffer-pool-test (Child aborted)
2019-10-25 14:21:36.059829 	 48 - free-list-test (Failed)
2019-10-25 14:21:36.059863 	 49 - reservation-tracker-test (Child aborted)
2019-10-25 14:21:36.059890 	 50 - suballocator-test (Failed)
2019-10-25 14:21:36.059917 	 51 - disk-io-mgr-test (Failed)
2019-10-25 14:21:36.059946 	 52 - data-cache-test (Child aborted)
2019-10-25 14:21:36.059977 	 53 - admission-controller-test (Failed)
2019-10-25 14:21:36.060015 	 59 - session-expiry-test (Child aborted)
2019-10-25 14:21:36.060043 	 67 - rpc-mgr-test (Child aborted)
2019-10-25 14:21:36.060076 	 68 - rpc-mgr-kerberized-test (Child aborted)
2019-10-25 14:21:36.060102 	 77 - bloom-filter-test (Failed)
2019-10-25 14:21:36.060127 	 85 - hdfs-util-test (Failed)
2019-10-25 14:21:36.060154 	 91 - min-max-filter-test (Failed)