[KUDU-2852] Push predicate evaluation into RLE Int type decoder

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: cfile, perf
• Labels: newbie
• Code Review: https://gerrit.cloudera.org/c/14380
• Assignee: Bankim Bhavsar
• Reporter: Andrew Wong
• Created: 13/Jun/19 18:40
• Updated: 21/Oct/19 17:54
• Resolved: 21/Oct/19 17:53

Description

Commit c0f3727 added an optimization to push predicate evaluation into the CFile decoders without fully materializing the contents of each cblock. It did this with dictionary-encoded blocks, but the optimization can be applied to any other encoding types too.

A low hanging fruit is RLE decoders, which should be able to evaluate the predicate for each run instead of materializing each cell and then applying the predicate.

KUDU-736 also notes that we may be able to apply some predicates on bitshuffled data.

 

Issue Links

• is cloned by: KUDU-2981 Push predicate evaluation into more CFile decoders