[IMPALA-11507] Impala cannot read Iceberg tables where DataFile is not under 'table location'

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Resolved
• Fix Version/s: Impala 4.2.0
• Labels: impala-iceberg
• Epic Color: ghx-label-2
• Assignee: Li Penglin
• Reporter: Li Penglin
• Created: 18/Aug/22 07:44
• Updated: 13/Dec/23 01:59
• Resolved: 09/Oct/22 03:56

Description

step1:
create Iceberg table 'ice_tbl', location is 'hdfs://localhost:20500/ice_tbl_x'

step2:
Using 'org.apache.iceberg.AppendFiles' to commit data
'hdfs://localhost:20500/ice_tbl_y/data/00001-1-486e37ac-0adc-4f32-b209-4ade2574d3c0-00004.parquet' to 'ice_tbl'

step3:

create external table ice_tbl
stored as iceberg
location 'hdfs://localhost:20500/ice_tbl_x'
tblproperties('iceberg.catalog' = 'hadoop.tables'); 

step4:
When we query 'ice_tbl', it will throw exception at https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/FeIcebergTable.java#L513

Issue Links

• breaks: IMPALA-11576 query_test.test_iceberg.test_multiple_storage_locations fails on S3