[FLINK-20379] Update KafkaRecordDeserializationSchema to enable reuse of DeserializationSchema and KafkaDeserializationSchema

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.12.0
• Fix Version/s: 1.13.0
• Component/s: Connectors / Kafka
• Labels: auto-deprioritized-critical auto-unassigned pull-request-available
• Assignee: Unassigned
• Reporter: Stephan Ewen
• Created: 26/Nov/20 12:51
• Updated: 12/Jan/22 18:51
• Resolved: 12/Jan/22 18:51

Description

The new Kafka Connector defines its own deserialization schema and is incompatible with the existing library of deserializers.

That means that users cannot use all of Flink's Formats (Avro, JSON, Csv, Protobuf, Confluent Schema Registry, ...) with the new Kafka Connector.

I think we should change the new Kafka Connector to use the existing Deserialization classes, so all formats can be used, and users can reuse their deserializer implementations.

It would also be good to use the existing KafkaDeserializationSchema. Otherwise all users need to migrate their sources again.

Issue Links

• links to: GitHub Pull Request #14303
• links to: GitHub Pull Request #15051