[PARQUET-116] Pass a filter object to user defined predicate in filter2 api

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: parquet-mr
• Assignee: Unassigned
• Reporter: Yash Datta
• Created: 18/Oct/14 05:41
• Updated: 23/Jun/24 03:27
• Resolved: 10/Feb/15 01:52

Description

Currently for creating a user defined predicate using the new filter api, no value can be passed to create a dynamic filter at runtime. This reduces the usefulness of the user defined predicate, and meaningful predicates cannot be created. We can add a generic Object value that is passed through the api, which can internally be used in the keep function of the user defined predicate for creating many different types of filters.
For example, in spark sql, we can pass in a list of filter values for a where IN clause query and filter the row values based on that list.

Issue Links

• is blocked by: HIVE-8122 Make use of SearchArgument classes for Parquet SERDE
• is duplicated by: PARQUET-115 Pass a filter object to user defined predicate in filter2 api