[CALCITE-5114] SqlParseException for Spark's "corr" function

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Duplicate
• Fix Version/s: 1.32.0

Environment

Running Calcite 1.30.0 with Java 11.

Language

Java

• Assignee: Unassigned
• Reporter: Laurens Versluis
• Created: 26/Apr/22 10:11
• Updated: 10/Sep/22 08:42
• Resolved: 27/Apr/22 05:01

Description

When parsing a string that contains Spark's "corr" function, Calcite will throw a SqlParseException.

 

Minimal reproducible example:

import org.apache.calcite.sql.dialect.SparkSqlDialect;
import org.apache.calcite.sql.parser.SqlParseException;
import org.apache.calcite.sql.parser.SqlParser;

class Scratch {
    public static void main(String[] args) throws SqlParseException {
        // Example SQL provided by spark, see https://spark.apache.org/docs/latest/api/sql/#corr
        String sqlQuery = "SELECT corr(c1, c2) FROM VALUES (3, 2), (3, 3), (6, 4) as tab(c1, c2);";
        SqlParser.create(sqlQuery, SparkSqlDialect.DEFAULT.configureParser(SqlParser.config())).parseQuery();
    }
} 

Output:

Exception in thread "main" org.apache.calcite.sql.parser.SqlParseException: Encountered "corr" at line 1, column 8.

Issue Links

• duplicates: CALCITE-1776 Implement CORR and REGR_* aggregate functions