[IMPALA-11093] Fine grained table refreshing doesn't refresh table file metadata

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.1.0
• Fix Version/s: Impala 4.1.0
• Component/s: Catalog
• Target Version: Impala 4.1.0
• Epic Color: ghx-label-9
• Assignee: Yu-Wen Lai
• Reporter: Yu-Wen Lai
• Created: 28/Jan/22 03:44
• Updated: 18/Feb/22 02:09
• Resolved: 17/Feb/22 20:04

Description

If we insert data into an acid partitioned table from Hive, the generated events will be like open_txn -> alter_partition -> commit_txn.

In alter_partition event, we will refresh the partition (without refreshing file metadata) because the write id with the partition object in the event > write id of the cached partition. Then, in commit_txn event, we still do the same write id check. However, the write id is still the same, so we end up don't fresh file metadata. 

Issue Links

• is caused by: IMPALA-10923 Fine grained table refreshing at partition level events for transactional tables