[CALCITE-5624] Add ARRAY function (enabled in Spark library)

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.34.0
• Fix Version/s: 1.35.0
• Component/s: core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Guillaume Massé
• Created: 30/Mar/23 18:11
• Updated: 11/Aug/23 22:54
• Resolved: 15/May/23 20:28

Description

The following query is valid in Apache Spark.

spark-shell

scala> spark.sql("""select array(1, 2, 3)""")
res1: org.apache.spark.sql.DataFrame = [array(1, 2, 3): array<int>]

However, it would fail to parse in Apache Calcite

 

AtomicRowExpression should not have ArrayConstructor for Apache Spark. Arrays are constructed by calling the array function (https://spark.apache.org/docs/latest/api/sql/index.html#array).

 

array()
array(1)
array(1, 2, 3)

Issue Links

• relates to: CALCITE-5628 Cannot parse map function for Spark Dialect
• relates to: CALCITE-5918 Add MAP function (enabled in Spark library)
• links to: GitHub Pull Request #3137
• links to: GitHub Pull Request #3141