[CALCITE-6618] Support NOT EQUALS operator in Arrow adapter

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.37.0
• Fix Version/s: 1.39.0
• Component/s: arrow-adapter
• Labels: pull-request-available
• Assignee: Caican Cai
• Reporter: Caican Cai
• Created: 08/Oct/24 14:47
• Updated: 6 days ago 00:37
• Resolved: 1 week ago 17:54

Description

Currently, Calcite's Arrow adapter does not support Not equal.
For example，

    String sql = "select \"intField\", \"stringField\"\n"
        + "from arrowdata\n"
        + "where \"intField\" <> 12";

    String plan = "PLAN=EnumerableCalc(expr#0..1=[{inputs}], expr#2=[12], expr#3=[<>($t0, $t2)], proj#0..1=[{exprs}], $condition=[$t3])\n"
        + "  ArrowToEnumerableConverter\n"
        + "    ArrowProject(intField=[$0], stringField=[$1])\n"
        + "      ArrowTableScan(table=[[ARROW, ARROWDATA]], fields=[[0, 1, 2, 3]])\n\n";

It can be optimized to

    String plan = "PLAN=ArrowToEnumerableConverter\n"
        + "  ArrowProject(intField=[$0], stringField=[$1])\n"
        + "    ArrowFilter(condition=[<>($0, 12)])\n"
        + "      ArrowTableScan(table=[[ARROW, ARROWDATA]], fields=[[0, 1, 2, 3]])\n\n";

Issue Links

• links to: GitHub Pull Request #3999