[HIVE-13491] Testing : log thread stacks when metastore fails to start

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0, 2.1.0
• Component/s: Test, Testing Infrastructure
• Labels: pull-request-available
• Target Version/s: 2.1.0
• Assignee: Thejas Nair
• Reporter: Thejas Nair
• Created: 12/Apr/16 07:29
• Updated: 04/Jun/20 21:36
• Resolved: 12/Apr/16 19:10

Description

Many tests are failing in ptest2 because metastore fails to startup in the expected time.
There is not enough information to figure out why the metastore startup failed/got hung in the hive.log file. Printing the thread dumps when that happens would be useful for finding the root cause.

The stack in test failure looks like this -

java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:198)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.loopUntilHMSReady(MetaStoreUtils.java:1208)
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.startMetaStore(MetaStoreUtils.java:1195)
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.startMetaStore(MetaStoreUtils.java:1177)
	at org.apache.hadoop.hive.thrift.TestHadoopAuthBridge23.setup(TestHadoopAuthBridge23.java:153)
	at org.apache.hadoop.hive.thrift.TestHadoopAuthBridge23.testMetastoreProxyUser(TestHadoopAuthBridge23.java:241)

Issue Links

• links to: GitHub Pull Request #71