[IMPALA-10626] Add support for Iceberg's Catalogs API

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.1.0
• Component/s: Frontend
• Labels: impala-iceberg
• Epic Link: Iceberg support in Impala
• Epic Color: ghx-label-2
• Assignee: Zoltán Borók-Nagy
• Reporter: Zoltán Borók-Nagy
• Created: 30/Mar/21 13:13
• Updated: 05/Aug/21 16:11
• Resolved: 05/Aug/21 16:11

Description

Some engines (e.g. Spark and Hive) use different table properties for defining catalog properties.

In the main hive configuration they store the following properties:

• iceberg.catalog.<catalog_name>.type = hadoop
• iceberg.catalog.<catalog_name>.warehouse = somelocation

On the table level they have the following properties:

• iceberg.catalog = <catalog_name>
• name = <database.table_name>

To load tables that use these kind of configurations we should use Iceberg's Catalogs class:

https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java

Probably we'll also want to use these properties by default in the future.