[HIVE-28371] Optimize add partitions authorization in HiveMetaStore

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.1.0
• Component/s: Standalone Metastore
• Labels: pull-request-available
• Assignee: Sai Hemanth Gantasala
• Reporter: Sai Hemanth Gantasala
• Created: 13/Jul/24 01:57
• Updated: 25/Jul/24 00:13
• Resolved: 25/Jul/24 00:13

Description

Currently add_partitions() api sends all the partitions (new partitions and existing partitions) that need to be added for authorization, instead, we can optimize this by sending only the new partitions for authorization.

Impact: Alter table recover partitions collects all the available partitions and sends it to Metastore to check if any new partitions can be added. If all the partitions are sent for authorization irrespective of whether it exists or not, the Authorization service will unnecessarily spend time on authorizing already existing partitions. This can be avoided by only authorizing new partitions.

Issue Links

• links to: GitHub Pull Request #5346