[IMPALA-10610] Support multiple file formats in a single Iceberg Table

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.2.0
• Component/s: Backend, Frontend
• Labels: impala-iceberg
• Epic Link: Iceberg support in Impala
• Target Version: Impala 4.2.0
• Epic Color: ghx-label-5
• Assignee: Gergely Fürnstáhl
• Reporter: Zoltán Borók-Nagy
• Created: 25/Mar/21 13:59
• Updated: 10/Jan/23 00:07
• Resolved: 14/Sep/22 09:06

Description

Iceberg allows having different file formats in a single table. It stores the file format information for each data file.

Impala only allows a single file format per partition. Iceberg tables are handled as non-partitioned HMS tables (Iceberg partitioning is more or less hidden from Impala). Therefore currently Impala don't allow having different file formats in a single table.