[IMPALA-12402] Make CatalogdMetaProvider's cache concurrency level configurable

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: Impala 4.4.0
• Component/s: Frontend
• Labels: pull-request-available
• Flags: Patch
• Epic Color: ghx-label-12

Language

C++ java

• Assignee: Maxwell Guo
• Reporter: Maxwell Guo
• Created: 25/Aug/23 03:31
• Updated: 16/Jul/24 23:43
• Resolved: 24/Oct/23 16:19

Description

when the cluster contains many db and tables such as if there are more than 100000 tables, and if we restart the impalad , the local cache_ CatalogMetaProvider's need to doing some loading process.
As we know that the goole's guava cache 's concurrencyLevel os set to 4 by default.
but if there is many tables the loading process will need more time and increase the probability of lock contention, see here.
So we propose to add some configurations here, the first is the concurrency of cache.