[KUDU-2981] Push predicate evaluation into more CFile decoders - ASF JIRA

Attach files

Attach Screenshot

Add vote

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: cfile, perf
Labels:
- performance

Description

Commit c0f3727 added an optimization to push predicate evaluation into the CFile decoders without fully materializing the contents of each cblock. It did this with dictionary-encoded blocks, but the optimization can be applied to any other encoding types too.

~~KUDU-736~~ also notes that we may be able to apply some predicates on bitshuffled data.