Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2852

Push predicate evaluation into RLE Int type decoder

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.11.0
    • cfile, perf

    Description

      Commit c0f3727 added an optimization to push predicate evaluation into the CFile decoders without fully materializing the contents of each cblock. It did this with dictionary-encoded blocks, but the optimization can be applied to any other encoding types too.

      A low hanging fruit is RLE decoders, which should be able to evaluate the predicate for each run instead of materializing each cell and then applying the predicate.

      KUDU-736 also notes that we may be able to apply some predicates on bitshuffled data.

       

      Attachments

        Issue Links

        is cloned by

        Improvement - An improvement or enhancement to an existing feature or task. KUDU-2981 Push predicate evaluation into more CFile decoders

        • Major - Major loss of function.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bankim Bankim Bhavsar
            awong Andrew Wong
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment