[BEAM-13400] JDBC IO does not support UUID and JSONB PostgreSQL types and OTHER JDBC types in general

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Affects Version/s: 2.34.0
• Fix Version/s: 2.37.0
• Component/s: io-java-jdbc
• Assignee: Vitaly Ivanov
• Reporter: Vitaly Ivanov
• Created: 07/Dec/21 16:56
• Updated: 14/Jan/22 18:17
• Resolved: 14/Jan/22 17:25

Description

The following exception occurs when trying to read rows from table which contains fields with type JSONB and UUID. They have JDBCType OTHER.

java.lang.UnsupportedOperationException: Converting OTHER to Beam schema type is not supported
    at org.apache.beam.sdk.io.jdbc.SchemaUtil.jdbcTypeToBeamFieldConverter(SchemaUtil.java:161)
    at org.apache.beam.sdk.io.jdbc.SchemaUtil.toBeamSchema(SchemaUtil.java:172)
    at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadRows.inferBeamSchema(JdbcIO.java:655)
    at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadRows.expand(JdbcIO.java:632)
    at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadRows.expand(JdbcIO.java:551)
    at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
    at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
    at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:56)

I suppose the issue is quite important because the UUID type is widespread in PostgeSQL.

 

Actual for Oracle BLOB as well.

Issue Links

• is related to: BEAM-7485 Some JDBC types do not have an equivalent Beam schema type
• links to: GitHub Pull Request #16284