[DRILL-7523] Update Calcite to 1.31.0

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.17.0
• Fix Version/s: Future
• Assignee: Vova Vysotskyi
• Reporter: Vova Vysotskyi
• Created: 13/Jan/20 11:50
• Updated: 07/Aug/22 18:44
• Resolved: 07/Aug/22 18:43

Description

Upgrade to Calcite 1.31 version.

Also, there are some fixes that may help to avoid specific commit for CALCITE-3121.

As discussed in CALCITE-2223, there were made additional changes for fixing this issue, so we should check whether we can remove the workaround made in DRILL-6212.

Incorporate with changes made in https://issues.apache.org/jira/browse/CALCITE-3774 - remove overriding shouldMergeProject and set withBloat(int bloat) in custom rel builder and investigate whether it would help to remove Hook.REL_BUILDER_SIMPLIFY hook.

Additionally, please check whether specific commit with ViewExpander may be removed due to changes made in CALCITE-2441.

Issue Links

• depends upon: DRILL-7526 Assertion Error when only type is used with schema in table function
• fixes: DRILL-7722 CREATE VIEW with LATERAL UNNEST creates an invalid view
• fixes: DRILL-8063 OOM planning a certain query
• fixes: DRILL-4086 Query hangs in planing
• fixes: DRILL-7526 Assertion Error when only type is used with schema in table function
• is blocked by: CALCITE-3749 JitPack build fails

Sub-Tasks

• Create builder for SqlSelect: Closed
• Introduce rule for converting join with distinct input to semi-join: Closed
• Add substring convertlet: Closed
• Replace deprecated RelNode.getChildExps with Project.getProjects: Closed
• Join queries fail with StackOverflowError: Closed
• Replace deprecated RelNode.getRows with RelNode.estimateRowCount: Closed
• Replace EnumerableTableScan usage with LogicalTableScan: Closed
• Use EVF-based JSON reader for Values operator: Closed
• Project pushdown depends on rules order and might not happen: Resolved