[HIVE-25936] ValidWriteIdList & table id are sometimes missing when requesting partitions by name via HS2

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: Stamatis Zampetakis
• Reporter: Stamatis Zampetakis
• Created: 07/Feb/22 17:35
• Updated: 17/Nov/22 08:48
• Resolved: 01/Jun/22 11:17

Description

According to HIVE-24743 the table id and ValidWriteIdList are important for keeping HMS remote metadata cache consistent. Although HIVE-24743 attempted to pass the write id list and table id in every call to HMS it failed to do so completely. For those partitions not handled in the batch logic, the metastore call in Hive#getPartitionsByName method does not pass the table id and write id list.

Issue Links

• is fixed by: HIVE-25935 Cleanup IMetaStoreClient#getPartitionsByNames APIs
• relates to: HIVE-24743 [HS2] Send tableId to get_partitions_by_names_req HMS API from HS2
• relates to: HIVE-26278 Add unit tests for Hive#getPartitionsByNames using batching
• links to: GitHub Pull Request #3007