[HIVE-25594] Setup JDBC databases in tests via QT options

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Testing Infrastructure
• Labels: pull-request-available
• Assignee: Stamatis Zampetakis
• Reporter: Stamatis Zampetakis
• Created: 06/Oct/21 15:56
• Updated: 17/Nov/22 08:48
• Resolved: 03/Nov/21 10:47

Description

The goal of this jira is to add a new QT option for setting up JDBC DBMS and using it in qtests which need a JDBC endpoint up and running. It can be used in tests with external JDBC tables, connectors, etc.

A sample file using the proposed option (qt:database) is shown below.

--!qt:database:postgres:init_sript_1234.sql:cleanup_script_1234.sql

CREATE EXTERNAL TABLE country (name varchar(80))
STORED BY 'org.apache.hive.storage.jdbc.JdbcStorageHandler'
TBLPROPERTIES (
"hive.sql.database.type" = "POSTGRES",
"hive.sql.jdbc.driver" = "org.postgresql.Driver",
"hive.sql.jdbc.url" = "jdbc:postgresql://localhost:5432/qtestDB",
"hive.sql.dbcp.username" = "qtestuser",
"hive.sql.dbcp.password" = "qtestpassword",
"hive.sql.table" = "country");
EXPLAIN CBO SELECT COUNT(*) from country;
SELECT COUNT(*) from country;

This builds upon HIVE-25423 but proposes to use JDBC datasources without the need for a using a specific CLI driver. Furthermore, the proposed QT option syntax allows using customised init/cleanup scripts for the JDBC datasource per test.

Issue Links

• Blocked: HIVE-25661 Cover the test case for HIVE-25626
• is depended upon by: HIVE-25668 Support database reuse when using qt:database option
• is related to: HIVE-26005 Run selected qtest on different metastore backends
• relates to: HIVE-25423 Add new test driver to automatically launch and load external database
• links to: GitHub Pull Request #2742