[IMPALA-3039] Restrict the number of runtime filters generated

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.2.4
• Fix Version/s: Impala 2.5.0
• Component/s: Frontend
• Labels: runtime-filters
• Target Version: Impala 2.5.0
• Assignee: Dimitris Tsirogiannis
• Reporter: Dimitris Tsirogiannis
• Created: 19/Feb/16 21:29
• Updated: 31/Mar/16 21:16
• Resolved: 25/Feb/16 02:24

Description

Problem:
Large queries with many runtime filters may fail for various reaasons (e.g. unaccounted thrift mem problem).

Desired behavior:
Be able to tune large queries to use a restricted set of runtime filters and run to completion.
Having to disable all runtime filters to make a query run is not desirable.

Solution:
Add query option to specify an upper bound N on the number of runtime filters generated for a query.