[IMPALA-10446] Add interop tests for Iceberg tables

• Type: Test
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: impala-iceberg
• Epic Color: ghx-label-13
• Assignee: Unassigned
• Reporter: Zoltán Borók-Nagy
• Created: 18/Jan/21 17:56
• Updated: 24/May/23 09:52

Description

Add interoperability tests for Iceberg table support between Impala and Hive.

At first we'll need to add Iceberg to our test environment and configure Hive to use it during runtime.

We need to test that Impala is able to read Iceberg tables written by Hive.

Also test that Hive is able to read Iceberg tables written by Impala.

• Have tests for all data types
• For all partition transforms
• Null values in data and/or partitioning columns
• Files with multiple row groups (written by Hive)
  • to test block location loading from Iceberg
• Unsupported column types
• Test map, struct and array data types and table conversion unility for these types
• Automatic metadata refresh when Hive writes the Iceberg table

 

Sub-Tasks

• Add tests for automatic metadata refresh for Iceberg tables: Open