[FLINK-18546] Upgrade to Kafka Schema Registry Client 5.5.0

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.11.0
• Fix Version/s: 1.12.0
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Labels: Avro avro pull-request-available
• Release Note: The flink-avro-confluent-schema-registry module is no longer provided as a fat-jar. You should include its dependencies in your job's fat-jar. Sql-client users can use flink-sql-avro-confluent-schema-registry fat jar.
• Assignee: Dawid Wysakowicz
• Reporter: Lucas Heimberg
• Created: 09/Jul/20 14:29
• Updated: 06/Nov/20 12:35
• Resolved: 06/Nov/20 12:35

Description

As of version 1.11, Flink (i.e., flink-avro-confluent-registry) still uses kafka-schema-registry-client in version 4.1.0.

From version 5.5.0 on, the Kafka schema registry client supports resolving of schema references (see https://docs.confluent.io/current/schema-registry/serdes-develop/index.html#referenced-schemas), i.e., schemas that are defined using schemas from other subjects. 

Therefore it would be great if Flink could make use of kafka-schema-registry-client in version 5.5.0 or higher in future releases.

 

 

Issue Links

• is a clone of: FLINK-18192 Upgrade to Avro version 1.10.0 from 1.8.2
• is related to: FLINK-18192 Upgrade to Avro version 1.10.0 from 1.8.2
• links to: GitHub Pull Request #13940