Description
Spark JDBC write only works with technologies which support the following INSERT statement syntax (JdbcUtils.scala: insertStatement()):
INSERT INTO $table VALUES ( ?, ?, ..., ? )
Some technologies require a list of column names:
INSERT INTO $table ( $colNameList ) VALUES ( ?, ?, ..., ? )
Therefore technologies like Progress JDBC Driver for Cassandra do not work with Spark JDBC write.
Idea for fix:
Move JdbcUtils.scala:insertStatement() into SqlDialect and add a SqlDialect for Progress JDBC Driver for Cassandra
Attachments
Issue Links
- relates to
-
SPARK-14460 DataFrameWriter JDBC doesn't Quote/Escape column names
- Resolved
- links to
I would like to work on this problem.