[SPARK-42552] Get ParseException when run sql: "SELECT 1 UNION SELECT 1;"

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.3
• Fix Version/s: 3.5.0
• Component/s: SQL

Environment

Scala version 2.12.15 (OpenJDK 64-Bit Server VM, Java 1.8.0_345)
Spark version 3.2.3-SNAPSHOT

• Assignee: Cheng Pan
• Reporter: jiang13021
• Created: 24/Feb/23 08:46
• Updated: 19/Apr/23 08:38
• Resolved: 19/Apr/23 08:37

Description

When I run sql

scala> spark.sql("SELECT 1 UNION SELECT 1;") 

I get ParseException:

org.apache.spark.sql.catalyst.parser.ParseException:
mismatched input 'SELECT' expecting {<EOF>, ';'}(line 1, pos 15)== SQL ==
SELECT 1 UNION SELECT 1;
---------------^^^  at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:266)
  at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:127)
  at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:51)
  at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:77)
  at org.apache.spark.sql.SparkSession.$anonfun$sql$2(SparkSession.scala:616)
  at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:111)
  at org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala:616)
  at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
  at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:613)
  ... 47 elided
 

If I run with parentheses , it works well 

scala> spark.sql("(SELECT 1) UNION (SELECT 1);") 
res4: org.apache.spark.sql.DataFrame = [1: int]

This should be a bug

 

 

Issue Links

• links to: [Github] Pull Request #40823 (Hisoka-X)