[ARROW-8600] [C++]Expose API for pushing down rep/def level comparison down to decoder

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: C++
• External issue URL: https://github.com/apache/arrow/issues/24765
• Assignee: Unassigned
• Reporter: Micah Kornfield
• Created: 27/Apr/20 04:12
• Updated: 11/Jan/23 08:01

Description

https://github.com/apache/arrow/pull/6985 shows the benefit of using SIMD for level to bitmap conversion.  We can do even better by exploiting RLE runs when doing comparisons.  Exposing an appropriate API and using that would likely improve real world use-cases even further.