[SPARK-43884] Allow parameter markers in DDL (again)

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: Spark Core
• Assignee: Serge Rielau
• Reporter: Serge Rielau
• Shepherd: Wenchen Fan
• Created: 30/May/23 17:02
• Updated: 11/Jun/23 05:03
• Resolved: 11/Jun/23 05:03

Description

When we introduced parameter markers initially, we allowed them n any SQL statement.
Subsequently, we have limited their use to DML and queries because that aligns better with the industry and we saw no immediate use for broader support.

However, we have introduced the IDENTIFIER() clause, which allows templating table-, and function-identifiers in DDL statements. 
To exploit this, we need parameter markers as argument:

spark.sql("CREATE TABLE IDENTIFIER(:tableName) (c1 INT)", args = Map("tableName" -> "mytable")