[HIVE-25753] Improving performance of getLatestCommittedCompactionInfo

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Standalone Metastore
• Labels: pull-request-available
• Assignee: Yu-Wen Lai
• Reporter: Yu-Wen Lai
• Created: 30/Nov/21 20:13
• Updated: 17/Nov/22 08:48
• Resolved: 19/Jan/22 01:39

Description

The API getLatestCommittedCompactionInfo is used by external cache server to check latest compaction id for tables/partitions.

Previously we have to set partition names for a partitioned table. That restriction causes a performance issue when a table with lots of partitions. We could remove this restriction so that when all the partitions are needed for a huge partitioned table we don't have to set all the partition names. That can reduce the size of the request and the overhead of sending request from client to HMS and from HMS to db.

Issue Links

• causes: HIVE-26041 Fix wrong type supplied for getLatestCommittedCompaction
• links to: GitHub Pull Request #2829