[IMPALA-11971] Simple syntax to Compact, RePartition, Clean Orphans etc for Iceberg Tables

• Type: Epic
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Frontend
• Labels: impala-iceberg
• Epic Name: Iceberg table maintenance tasks
• Epic Color: ghx-label-9
• Assignee: Unassigned
• Reporter: Manish Maheshwari
• Created: 06/Mar/23 11:54
• Updated: 19/Sep/23 08:41

Description

Impala supports overwriting iceberg tables. Overwriting iceberg tables / partitions can be used as an cheap way to implement the below without the user having to run spark jobs

• compact small files
• rewrite partitions according to latest spec
• merge deltas due to deletes and updates (if any) due to Merge-on-read strategy
• delete orphan files in table/partition

Doing all of this as part of an overwrite partition is not intuitive. We should support a syntax verb like `compact` or `consolidate` or `tune` to do these operations 

alter table compact table;
alter table compact table partition <>;
alter table compact table partition <>;