[SPARK-40585] Support double-quoted identifiers

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Spark Core
• Assignee: Serge Rielau
• Reporter: Serge Rielau
• Shepherd: Wenchen Fan
• Created: 27/Sep/22 18:20
• Updated: 07/Oct/22 05:39
• Resolved: 04/Oct/22 23:11

Description

In many SQL identifiers can be unquoted or quoted with double quotes. 
In Spark double quoted literals imply strings.
In this proposal we allow for a config:

double_quoted_identifiers
which, when set, switches the interpretation from string to identifier.

Note that back ticks are still allowed.
Also the treatment of escapes is not changed as part of this work.

Issue Links

• links to: [Github] Pull Request #38022 (srielau)
• links to: [Github] Pull Request #38022 (srielau)
• links to: [Github] Pull Request #38111 (gengliangwang)
• links to: [Github] Pull Request #38147 (gengliangwang)