[HIVE-22074] Slow compilation due to IN to OR transformation

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Logical Optimizer
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Vineet Garg
• Reporter: Vineet Garg
• Created: 01/Aug/19 21:41
• Updated: 27/Feb/24 22:23
• Resolved: 23/Aug/19 20:26

Description

Currently Hive transform IN expressions to OR to apply various CBO rules. This incur significant performance hit if IN consist of large number of expressions.
It is better to not transform IN expressions to OR in such cases because overall benefit of various optimizations/transformations is unrealized due to the compilation overhead

Issue Links

• links to: GitHub Pull Request #746