[FLINK-20873] Upgrade Calcite version to 1.27

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.17.0
• Component/s: Table SQL / API, Table SQL / Planner
• Labels: pull-request-available
• Release Note: Calcite upgrade brings optimization changing logical plans for some queries involving `Sarg` and queries with`count` of non-distinct values
• Assignee: Sergey Nuyanzin
• Reporter: Jark Wu
• Created: 07/Jan/21 02:29
• Updated: 19/Apr/23 06:58
• Resolved: 21/Oct/22 07:53

Description

The following files should be removed from the Flink code base during an upgrade:

• org.apache.calcite.rex.RexSimplify
• org.apache.calcite.sql.SqlMatchRecognize
• org.apache.calcite.sql.SqlTableRef
• org.apache.calcite.sql2rel.RelDecorrelator
• org.apache.flink.table.planner.functions.sql.SqlJsonObjectFunction (added in FLINK-16203)
• Adopt calcite's behaviour and add SQL tests once https://github.com/apache/calcite/pull/2555 is merged, (check FLINK-24576 )

Issue Links

• blocks: FLINK-18027 ROW value constructor cannot deal with complex expressions
• depends upon: FLINK-24576 Drop support for casting decimal numerics to boolean for SQL
• fixes: FLINK-18027 ROW value constructor cannot deal with complex expressions
• is related to: FLINK-26549 INSERT INTO with VALUES leads to wrong type inference with nested types
• is related to: FLINK-21239 Upgrade Calcite version to 1.28
• is related to: FLINK-27995 Upgrade Janino version
• is related to: FLINK-27998 Upgrade Calcite version to 1.30
• relates to: FLINK-31066 Release Testing: Verify FLINK-29932 Upgrade Calcite to 1.29.0
• relates to: FLINK-29319 Upgrade Calcite version to 1.32
• relates to: FLINK-29540 SubQueryAntiJoinTest started to fail after Calcite 1.27
• links to: GitHub Pull Request #20850

Sub-Tasks

• CliClient fails with NPE during start (after calcite update to 1.27): Resolved
• JoinITCase#testUncorrelatedScalar fails with Cannot generate a valid execution plan for the given query after calcite update 1.27: Closed