[SPARK-18502] Spark does not handle columns that contain backquote (`)

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Barry Becker
• Created: 18/Nov/16 14:40
• Updated: 05/Dec/22 19:36
• Resolved: 21/May/19 04:11

Description

I know that if a column contains dots or hyphens we can put backquotes/backticks around it, but what if the column contains a backtick (`)? Can the back tick be escaped by some means?

Here is an example of the sort of error I see

org.apache.spark.sql.AnalysisException: syntax error in attribute name: `Invoice`Date`;org.apache.spark.sql.catalyst.analysis.UnresolvedAttribute$.e$1(unresolved.scala:99) org.apache.spark.sql.catalyst.analysis.UnresolvedAttribute$.parseAttributeName(unresolved.scala:109) org.apache.spark.sql.catalyst.analysis.UnresolvedAttribute$.quotedString(unresolved.scala:90) org.apache.spark.sql.Column.(Column.scala:113) org.apache.spark.sql.Column$.apply(Column.scala:36) org.apache.spark.sql.functions$.min(functions.scala:407) com.mineset.spark.vizagg.vizbin.strategies.DateBinStrategy.getDateExtent(DateBinStrategy.scala:158)