[HIVE-25675] Intermittent PSQLException when trying to connect to Postgres in tests

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Testing Infrastructure
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Stamatis Zampetakis
• Reporter: Stamatis Zampetakis
• Created: 05/Nov/21 12:28
• Updated: 17/Nov/22 08:47
• Resolved: 08/Nov/21 14:23

Description

The following exception appears intermittently when running tests using dockerized Postgres.

Unexpected exception org.postgresql.util.PSQLException: FATAL: the database system is starting up
21:26:55  	at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:525)
21:26:55  	at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:146)
21:26:55  	at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:197)
21:26:55  	at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
21:26:55  	at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:217)
21:26:55  	at org.postgresql.Driver.makeConnection(Driver.java:458)
21:26:55  	at org.postgresql.Driver.connect(Driver.java:260)
21:26:55  	at java.sql.DriverManager.getConnection(DriverManager.java:664)
21:26:55  	at java.sql.DriverManager.getConnection(DriverManager.java:247)
21:26:55  	at org.apache.hadoop.hive.ql.externalDB.AbstractExternalDB.execute(AbstractExternalDB.java:191)
21:26:55  	at org.apache.hadoop.hive.ql.qoption.QTestDatabaseHandler.beforeTest(QTestDatabaseHandler.java:116)
21:26:55  	at org.apache.hadoop.hive.ql.qoption.QTestOptionDispatcher.beforeTest(QTestOptionDispatcher.java:79)
21:26:55  	at org.apache.hadoop.hive.ql.QTestUtil.cliInit(QTestUtil.java:717)
21:26:55  	at org.apache.hadoop.hive.cli.control.CoreCliDriver.runTest(CoreCliDriver.java:189)
21:26:55  	at org.apache.hadoop.hive.cli.control.CliAdapter.runTest(CliAdapter.java:104)
21:26:55  	at org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver(TestMiniLlapLocalCliDriver.java:62)

As the exception indicates when we try to connect to Postgres the database is not yet completely ready despite the fact that the respective port is open thus leading to the previous exception.

Issue Links

• relates to: HIVE-24395 Intermittent failures to initialize dockerized Postgres metastore in tests
• links to: GitHub Pull Request #2767