[IMPALA-13401] Catalog abstraction layer

• Type: Epic
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Catalog, Frontend
• Epic Name: Catalog abstraction layer
• Epic Color: ghx-label-3
• Assignee: Peter Rozsa
• Reporter: Peter Rozsa
• Created: 24/Sep/24 06:34
• Updated: 24/Sep/24 06:34

Description

Apache Impala only supports Hive Metastore as a metadata provider. New table formats and catalog implementations showed up (AWS Glue, REST Catalog implementations for Iceberg, ...).

To prepare Impala for these challenges, we should introduce a new, catalog layer that could hide the implementation differences of these new emerging catalogs by providing an interface each catalog could implement.