[HIVE-8313] Optimize evaluation for ExprNodeConstantEvaluator and ExprNodeNullEvaluator

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.12.0, 0.13.0, 0.14.0
• Fix Version/s: 0.14.0
• Component/s: Query Processor
• Labels: Performance
• Assignee: Mithun Radhakrishnan
• Reporter: Mithun Radhakrishnan
• Created: 30/Sep/14 20:55
• Updated: 13/Nov/14 19:42
• Resolved: 03/Nov/14 02:01

Description

Consider the following query:

SELECT foo, bar, goo, id
FROM myTable
WHERE id IN ( 'A', 'B', 'C', 'D', ... , 'ZZZZZZ' );

One finds that when the IN clause has several thousand elements (and the table has several million rows), the query above takes orders-of-magnitude longer to run on Hive 0.12 than say Hive 0.10.

I have a possibly incomplete fix.

Issue Links

• is related to: HIVE-8188 ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop