[SPARK-8616] SQLContext doesn't handle tricky column names when loading from JDBC

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.4.0
• Component/s: SQL

Environment

Ubuntu 14.04, Sqlite 3.8.7, Spark 1.4.0

• Assignee: Unassigned
• Reporter: Gergely Svigruha
• Created: 25/Jun/15 02:13
• Updated: 28/Dec/15 13:06
• Resolved: 28/Dec/15 13:06

Description

Reproduce:

• create a table in a relational database (in my case sqlite) with a column name containing a space:
  CREATE TABLE my_table (id INTEGER, "tricky column" TEXT);
• try to create a DataFrame using that table:
  sqlContext.read.format("jdbc").options(Map(
  "url" -> "jdbs:sqlite:...",
  "dbtable" -> "my_table")).load()

java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database (no such column: tricky)

According to the SQL spec this should be valid:
http://savage.net.au/SQL/sql-99.bnf.html#delimited%20identifier

Issue Links

• duplicates: SPARK-12437 Reserved words (like table) throws error when writing a data frame to JDBC
• is duplicated by: SPARK-9505 DataFrames : Mysql JDBC not support column names with special characters
• relates to: SPARK-6666 org.apache.spark.sql.jdbc.JDBCRDD does not escape/quote column names