[IMPALA-7958] Instrument catalog lock objects to dump diagnostics

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 3.1.0
• Component/s: Catalog
• Labels: supportability
• Epic Link: SupportabilityRoadMap
• Epic Color: ghx-label-4
• Assignee: Unassigned
• Reporter: Bharath Vissapragada
• Created: 11/Dec/18 21:16
• Updated: 07/Jul/20 13:19

Description

If a particular thread is holding a given lock for longer than X ms (configurable), we should dump the following information to the logs.

• Thread stack of the thread holding the lock
• Thread stacks of the threads blocked on this lock.

We initially need to do this for the re-entrant table lock protecting concurrent table updates. We can also do this for catalogVersionLock_ but we don't anticipate much contention around it with v2 architecture.

The idea is to root cause Catalog hangs better, especially in the context of concurrent table updates.