[HIVE-26882] Allow transactional check of Table parameter before altering the Table

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.3.10, 4.0.0-beta-1
• Component/s: Standalone Metastore
• Labels: pull-request-available
• Assignee: Peter Vary
• Reporter: Peter Vary
• Created: 21/Dec/22 09:12
• Updated: 14/Oct/24 22:48
• Resolved: 08/Jan/23 22:27

Description

We should add the possibility to transactionally check if a Table parameter is changed before altering the table in the HMS.

This would provide an alternative, less error-prone and faster way to commit an Iceberg table, as the Iceberg table currently needs to:

• Create an exclusive lock
• Get the table metadata to check if the current snapshot is not changed
• Update the table metadata
• Release the lock

After the change these 4 HMS calls could be substituted with a single alter table call.
Also we could avoid cases where the locks are left hanging by failed processes

Issue Links

• is required by: IMPALA-12768 Set iceberg.engine.hive.lock-enabled To false By Default
• links to: GitHub Pull Request #3888 - master
• links to: GitHub Pull Request #3943 - branch-3
• links to: GitHub Pull Request #3944 - branch-3.1
• links to: GitHub Pull Request #3946 - branch-2
• links to: GitHub Pull Request #3947 - branch-2.3
• links to: GitHub Pull Request #6570
• links to: GitHub Pull Request #7418