[SPARK-47282] 'parseTableIdentifier' fails when a catalog name is provided

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.5.0, 4.0.0
• Component/s: Spark Core

Language

Scala

• Assignee: Unassigned
• Reporter: Denis Tarima
• Created: 05/Mar/24 08:51
• Updated: 05/Mar/24 08:51

Description

spark.sessionState.sqlParser.parseTableIdentifier(
  "`my catalog`.`my database`.`my table`"
)

fails with

org.apache.spark.sql.catalyst.parser.ParseException: 
[PARSE_SYNTAX_ERROR] Syntax error at or near '.'.(line 1, pos 26)

== SQL ==
`my catalog`.`my database`.`my table`
--------------------------^^^

	at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(parsers.scala:257)
	at org.apache.spark.sql.catalyst.parser.AbstractParser.parse(parsers.scala:98)
	at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:54)
	at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parseTableIdentifier(AbstractSqlParser.scala:41)

 

Note: It works as expected on Databricks clusters (verified with Spark 3.3.2 and 3.5.0).