[HIVE-24176] Create query-level cache for HMS requests and extend existing local HS2 HMS cache

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: HiveServer2
• Labels: pull-request-available
• Assignee: Jesús Camacho Rodríguez
• Reporter: Jesús Camacho Rodríguez
• Created: 18/Sep/20 03:02
• Updated: 27/Feb/24 22:23
• Resolved: 19/Sep/20 20:01

Description

This issue creates a query-level cache for HMS requests. The lifecycle of that cache is associated to the lifecycle of the query. This basically means that each unique request to certain HMS APIs should only be served once from HMS, while follow-up repetitive calls will be retrieved from cache. The initial implementation includes caching for 19 APIs.

This issue also extends existing local HS2 HMS cache implementation introduced in HIVE-23949 to support other requests (getTableColumnStatistics, getPartitionsByNames). In fact, implementation relies on some of the logic introduced in that JIRA since there are some commonalities.

Issue Links

• is related to: HIVE-24183 Clean up local HS2 HMS cache code
• relates to: HIVE-23949 Introduce caching layer in HS2 to accelerate query compilation
• links to: GitHub Pull Request #1504