Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4864

Speed up binary predicates against dictionary encoded Parquet data by converting the predicates to their codewords

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 2.9.0
    • None
    • Backend

    Description

      Selective binary predicates against dictionary-encoded columns can be speeded up by converting the original predicates on the column type to predicates on the dictionary codewords, this should help avoid expensive comparisons.

      Similar to Kudu
      https://kudu.apache.org/2016/09/16/predicate-pushdown.html
      https://github.com/cloudera/kudu/commit/c0f37278cb09a7781d9073279ea54b08db6e2010
      https://github.com/cloudera/kudu/commit/ec80fdb37be44d380046a823b5e6d8e2241ec3da

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-2735 Push down conjunct evaluation into Parquet column readers

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-4123 Columnar decoding in Parquet scanner

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              mmokhtar Mostafa Mokhtar
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: