Description
Currently, the SQL Parser dialect is hard code in SQLContext, which is not easy to extend, we need the features like:
bin/spark-sql --driver-class-path customizedSQL92.jar -- switch to "hiveql" dialect spark-sql>SET spark.sql.dialect=hiveql; spark-sql>SELECT * FROM src LIMIT 1; -- switch to "sql" dialect spark-sql>SET spark.sql.dialect=sql; spark-sql>SELECT * FROM src LIMIT 1; -- register the new SQL dialect spark-sql> SET spark.sql.dialect.sql99=com.xxx.xxx.SQL99Dialect; spark-sql> SET spark.sql.dialect=sql99; spark-sql> SELECT * FROM src LIMIT 1; -- register the non-exist SQL dialect spark-sql> SET spark.sql.dialect.sql92=NotExistedClass; spark-sql> SET spark.sql.dialect=sql92; spark-sql> SELECT * FROM src LIMIT 1; -- Exception will be thrown and switch to dialect "sql" (for SQLContext) or "hiveql" (for HiveContext)
Attachments
Issue Links
- is duplicated by
-
SPARK-6200 Support dialect in SQL
-
- Resolved
-
- links to
