[IMPALA-6621] Improve In-predicate performance by using an alternative data structure for checking set membership

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.13.0
• Fix Version/s: Impala 2.13.0
• Component/s: Backend
• Epic Color: ghx-label-4
• Assignee: Bikramjeet Vig
• Reporter: Bikramjeet Vig
• Created: 07/Mar/18 20:18
• Updated: 30/Mar/18 17:02
• Resolved: 29/Mar/18 20:09

Description

Currently when using a SET_LOOKUP strategy for in-predicates in impala we use an std:set object for checking membership.
Using other data structures like boost::unordered_set and boost::flat_set we can get a significant performance improvement. Please see attached results of micro benchmarks using std::set, flat_set and unordered_set.

Issue Links

• breaks: IMPALA-6771 Incorrect results introduced by IMPALA-6621