Description
The current Spark has many non-reserved words that are essentially reserved in the ANSI/SQL standard (http://developer.mimer.se/validator/sql-reserved-words.tml).
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4#L709
This is because there are many datasources (for instance twitter4j) that unfortunately use reserved keywords for column names (See hvanhovell's comments: https://github.com/apache/spark/pull/18079#discussion_r118842186). We might fix this issue in future major releases.
Attachments
Issue Links
- is related to
-
SPARK-26215 define reserved keywords after SQL standard
- Resolved
- relates to
-
SPARK-26215 define reserved keywords after SQL standard
- Resolved