[IMPALA-11620] Enable setting 'write.format.default'

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.3.0
• Component/s: Frontend
• Labels: impala-iceberg ramp-up
• Epic Color: ghx-label-11
• Assignee: Noemi Pap-Takacs
• Reporter: Zoltán Borók-Nagy
• Created: 28/Sep/22 15:12
• Updated: 11/Jan/23 14:58
• Resolved: 11/Jan/23 14:58

Description

Before IMPALA-10610 we didn't support Iceberg tables with mixed-format data files.

And we used 'write.format.default' to determine the file format of the table, which was only a temporary workaround. Because of this we didn't allow changing this table property if the table already contained different table formats. E.g. we didn't allow modifying 'write.format.default' to PARQUET if the table already contained ORC files, because it would have made the table unreadable for Impala.

Since IMPALA-10610 'write.format.default' is not used to determine the Iceberg table's format anymore, so we can allow changing it.

Issue Links

• is duplicated by: IMPALA-11691 Enable writing Iceberg tables with multiple file formats
• is related to: IMPALA-10597 Enable setting 'iceberg.file_format'