[ARROW-10016] [Rust] [DataFusion] Implement IsNull and IsNotNull

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Rust, Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26040
• Assignee: Jörn Horstmann
• Reporter: Jorge Leitão
• Created: 15/Sep/20 14:01
• Updated: 11/Jan/23 08:10
• Resolved: 23/Sep/20 11:03

Description

Currently, DataFusion has the logical operator `isNull` and `IsNotNull`, but that operator has no physical implementation. Consequently, this operator cannot be used.

The goal of this improvement is to add support to this operator on the physical plan.

Note that these operators only care about the null bitmap, and thus should be implementable to all types supported by Arrow.

Both operators should probably return a non-null `BooleanArray`.

Issue Links

• fixes: ARROW-10025 [Rust] Filter kernel relies on bits outside of valid len of boolean array
• links to: GitHub Pull Request #8204