Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4864

Speed up binary predicates against dictionary encoded Parquet data by converting the predicates to their codewords

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 2.9.0
    • None
    • Backend

    Description

      Selective binary predicates against dictionary-encoded columns can be speeded up by converting the original predicates on the column type to predicates on the dictionary codewords, this should help avoid expensive comparisons.

      Similar to Kudu
      https://kudu.apache.org/2016/09/16/predicate-pushdown.html
      https://github.com/cloudera/kudu/commit/c0f37278cb09a7781d9073279ea54b08db6e2010
      https://github.com/cloudera/kudu/commit/ec80fdb37be44d380046a823b5e6d8e2241ec3da

      Attachments

        Issue Links

        relates to

        Improvement - An improvement or enhancement to an existing feature or task. IMPALA-2735 Push down conjunct evaluation into Parquet column readers

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IMPALA-4123 Columnar decoding in Parquet scanner

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            mmokhtar Mostafa Mokhtar
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment