[FLINK-9172] Support catalogs in SQL-Client yaml config file

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: Table SQL / Client
• Labels: pull-request-available
• Assignee: Bowen Li
• Reporter: Rong Rong
• Created: 14/Apr/18 00:50
• Updated: 01/Oct/19 15:38
• Resolved: 29/May/19 02:38

Description

It doesn't seem that the configuration (YAML) file allows specifications of external catalogs currently. The request here is to add support for external catalog specifications in YAML file. User should also be able to specify one catalog is the default.

It will be great to have SQL-Client to support some external catalogs out-of-the-box for SQL users to configure and utilize easily. I am currently think of having an external catalog factory that spins up both streaming and batch external catalog table sources and sinks. This could greatly unify and provide easy access for SQL users.

The catalog-related configurations then need to be processed and passed to TableEnvironment accordingly by calling relevant APIs.

Issue Links

• Blocked: FLINK-11234 ExternalTableCatalogBuilder unable to build a batch-only table
• is blocked by: FLINK-11476 Create CatalogManager to manage multiple catalogs and encapsulate Calcite schema
• is blocked by: FLINK-11240 Implement external catalog factory and descriptor
• is duplicated by: FLINK-10759 Adapt SQL-client configuration file to specify external catalogs and default catalog
• relates to: FLINK-9157 Support Apache HCatalog in SQL client
• relates to: FLINK-10696 Add APIs to ExternalCatalog for views and UDFs
• links to: GitHub Pull Request #7393
• links to: GitHub Pull Request #8541