[BEAM-7312] SchemaProvider can't be used with dynamic types

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Won't Fix
• Fix Version/s: 2.14.0
• Component/s: sdk-java-core
• Labels: Done
• Assignee: Alex Van Boxel
• Reporter: Alex Van Boxel
• Created: 15/May/19 11:41
• Updated: 06/Oct/20 21:55
• Resolved: 31/Aug/19 05:38

Description

Looking at the java doc comment of SchemaProvider it hints at getting schema's from external system. But as the provider only access type this is in general impossible:

Say you have 2 dynamic types, say Avro, as a java type they have both GenericRecord. Using the current interface it's impossible to make the difference between both dynamic types.

As getting information from an external system I propose extending the Provider interface by adding an extra parameter to the interface. It would be a string with a URN.

The URN could indicated for example

• Pub/Sub subscription/topic
• Kafka topic
• whatever...