Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2852

Push predicate evaluation into RLE Int type decoder

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.11.0
    • Component/s: cfile, perf
    • Labels:

      Description

      Commit c0f3727 added an optimization to push predicate evaluation into the CFile decoders without fully materializing the contents of each cblock. It did this with dictionary-encoded blocks, but the optimization can be applied to any other encoding types too.

      A low hanging fruit is RLE decoders, which should be able to evaluate the predicate for each run instead of materializing each cell and then applying the predicate.

      KUDU-736 also notes that we may be able to apply some predicates on bitshuffled data.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bankim Bankim Bhavsar
                Reporter:
                awong Andrew Wong
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: