Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-115

Pass a filter object to user defined predicate in filter2 api

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 1.6.0
    • 1.6.0
    • parquet-mr
    • None

    Description

      Currently for creating a user defined predicate using the new filter api, no value can be passed to create a dynamic filter at runtime. This reduces the usefulness of the user defined predicate, and meaningful predicates cannot be created. We can add a generic Object value that is passed through the api, which can internally be used in the keep function of the user defined predicate for creating many different types of filters.
      For example, in spark sql, we can pass in a list of filter values for a where IN clause query and filter the row values based on that list.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              saucam Yash Datta
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: