[IMPALA-11158] Add support for Iceberg tables with AVRO data files

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.3.0
• Component/s: Backend, Frontend
• Labels: impala-iceberg
• Target Version: Impala 4.3.0
• Epic Color: ghx-label-4
• Assignee: Noemi Pap-Takacs
• Reporter: Zoltán Borók-Nagy
• Created: 04/Mar/22 11:06
• Updated: 21/Dec/22 09:52
• Resolved: 21/Dec/22 09:52

Description

Impala currently only supports Iceberg tables with Parquet and ORC data files.

The Iceberg spec also allows AVRO data files. Hive/Spark already support such tables.

We should also add support for Iceberg tables using AVRO.

Issue Links

• fixes: IMPALA-10569 Impala should determine Iceberg data file format from Iceberg metadata

Sub-Tasks

• Add support for AVRO-only Iceberg tables: Resolved
• Add support for mixed Iceberg tables with AVRO file format: Resolved