Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10898

Runtime IN-list filters for ORC tables

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • Impala 4.1.0
    • Backend
    • None

    Description

      Currently Impala has two kinds of runtime filters: bloom filter and min-max filter. Unfortunately they can't leverage the bloom filters in ORC files. Only EQUALS and IN-list
      predicates can leverage them to skip unrelated ORC RowGroups.

      This JIRA aims to add runtime IN-list filters for small build side (e.g. #rows <= 1024) of a hash join.

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-9470 Use Parquet bloom filters

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-11066 Runtime IN-list filters for Kudu tables

          • Major - Major loss of function.
          • Open
          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. IMPALA-11138 Runtime IN-list filter support

          • Major - Major loss of function.
          • Open

          Activity

            People

              stigahuang Quanlong Huang
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: