[BEAM-13717] Can't use java logical types defined in Java JDBC IO in XLang JDBC pipeline for Go and Python

• Type: Bug
• Status: Open
• Priority: P2
• Resolution: Unresolved
• Component/s: io-java-jdbc
• Assignee: Unassigned
• Reporter: Ritesh Ghorse
• Created: 21/Jan/22 22:54
• Updated: 04/Jun/22 23:31

Description

Currently, we can't use the logical types defined in java JDBC IO in XLang pipelines for JDBC IO in Go SDK as it throws the following error:

  unmarshalling coder jFYvjSCanTRowCoder_length_prefixed_windowed
        unmarshalling coder jFYvjSCanTRowCoder_length_prefixed
cannot convert schema field role_name to field
        caused by:
unknown logical type: beam:logical_type:javasdk:v1 

This is the structure of table and its corresponding struct:

// roles=> CREATE TABLE roles(
//         role_id serial PRIMARY KEY,
//         role_name VARCHAR (255) UNIQUE
//  );

type JdbcTestRow struct {
        Role_id   int32  `beam:"role_id"`
        Role_name string `beam:"role_name"`
} 

Similar error seems to be appearing on Python SDK pipeline based on this stack overflow question: (https://stackoverflow.com/questions/68758361/error-beamlogical-typejavasdkv1-while-using-apache-beam-io-jdbc-readfromjdbc)