[IMPALA-10817] Share metastoreHmsDDL lock b/w CatalogOpExecutor and Catalog metastore server

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.1.0
• Component/s: Catalog
• Epic Color: ghx-label-8
• Assignee: Sourabh Goyal
• Reporter: Sourabh Goyal
• Created: 21/Jul/21 16:54
• Updated: 03/Dec/21 05:39
• Resolved: 16/Aug/21 17:22

Description

Currently, when doing create/drop table/db from catalogD, catalogOpExecutor (via Impala Shell) and metastore server (via HS2) acquires lock on their own respective lock objects to prevent concurrent create/drop operations in HMS. But that does not prevent these concurrent operations across CatalogOpExecutor and Metastore server. For example currently a user can perform create/drop HMS operation from Impala shell and catalog metastore server concurrently which is not the desired behavior

Issue Links

• is related to: IMPALA-10837 Add tests for IMPALA-10817