[CALCITE-6295] Support IS NOT NULL in Arrow adapter

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.37.0
• Fix Version/s: 1.38.0
• Component/s: arrow-adapter
• Labels: pull-request-available
• Assignee: Tim Grein
• Reporter: hongyu guo
• Created: 05/Mar/24 03:25
• Updated: 6 days ago 22:41
• Resolved: 6 days ago 22:41

Description

For example:

select "intField", "stringField"
from arrowdata
where "intField" is not null
order by "intField"
limit 1

will throw an exception

java.lang.AssertionError: cannot translate IS NOT NULL($0)

	at org.apache.calcite.adapter.arrow.ArrowTranslator.translateMatch2(ArrowTranslator.java:131)
	at org.apache.calcite.adapter.arrow.ArrowTranslator.translateAnd(ArrowTranslator.java:111)
	at org.apache.calcite.adapter.arrow.ArrowTranslator.translateMatch(ArrowTranslator.java:68)
	at org.apache.calcite.adapter.arrow.ArrowFilter.<init>(ArrowFilter.java:43)
	at org.apache.calcite.adapter.arrow.ArrowRules$ArrowFilterRule.convert(ArrowRules.java:97)
	at org.apache.calcite.adapter.arrow.ArrowRules$ArrowFilterRule.onMatch(ArrowRules.java:87)

Issue Links

• links to: GitHub Pull Request #3868