[SPARK-15987] PostgreSQL CITEXT type JDBC support

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 1.6.1
• Component/s: SQL
• Labels: bulk-closed dataframe jdbc postgresql

Environment

Ubuntu 14.04
PostgreSQL 9.3.9

• Assignee: Unassigned
• Reporter: Sergey Bahchissaraitsev
• Created: 16/Jun/16 11:49
• Updated: 21/May/19 04:36
• Resolved: 21/May/19 04:36

Description

When trying to use spark data frame on a table with CITEXT type you get the following error:

Exception in thread "main" java.sql.SQLException: Unsupported type 1111
at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.org$apache$spark$sql$execution$datasources$jdbc$JDBCRDD$$getCatalystType(JDBCRDD.scala:102)
at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$$anonfun$1.apply(JDBCRDD.scala:141)
at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$$anonfun$1.apply(JDBCRDD.scala:141)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.resolveTable(JDBCRDD.scala:140)
at org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation.<init>(JDBCRelation.scala:91)
at org.apache.spark.sql.DataFrameReader.jdbc(DataFrameReader.scala:222)
at org.apache.spark.sql.DataFrameReader.jdbc(DataFrameReader.scala:208)