Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6505

Min-Max predicate push down in ORC scanner

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • Impala 4.1.0
    • Backend
    • None

    Description

      For parquet tables, we push down predicates that can be used with file level statistics to filter out row groups. It's controlled by the PARQUET_READ_STATISTICS query option.

      We can do the same for ORC tables after ORC-751 (support predicate pushdown in C++ reader) is resolved.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-10922 test_orc_stats failing on exhaustive builds

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-10890 Show pushed down predicates in query plan

          • Major - Major loss of function.
          • Open
          links to

          Web Link Code Review

          Activity

            People

              norbertluksa Norbert Luksa
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: