[HIVE-18920] CBO: Initialize the Janino providers ahead of 1st query

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: CBO
• Labels: pull-request-available
• Assignee: Jesús Camacho Rodríguez
• Reporter: Gopal Vijayaraghavan
• Created: 09/Mar/18 01:58
• Updated: 27/Feb/24 22:23
• Resolved: 04/Mar/19 19:23

Description

Hive Calcite metadata providers are compiled when the 1st query comes in.

If a second query arrives before the 1st one has built a metadata provider, it will also try to do the same thing, because the cache is not populated yet.

With 1024 concurrent users, it takes 6 minutes for the 1st query to finish fighting all the other queries which are trying to load that cache.

Issue Links

• relates to: HIVE-25472 Prevent hive-server2 from getting OOM(Compressed class space) (Backport HIVE-18920)
• supercedes: HIVE-21343 CBO: CalcitePlanner debug logging is expensive and costly
• links to: GitHub Pull Request #2596