[FLINK-6022] Don't serialise Schema when serialising Avro GenericRecord

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: API / Type Serialization System
• Assignee: Stephan Ewen
• Reporter: Robert Metzger
• Created: 10/Mar/17 10:50
• Updated: 02/Oct/19 17:45
• Resolved: 19/Nov/18 18:29

Description

Currently, Flink is serializing the schema for each Avro GenericRecord in the stream.
This leads to a lot of overhead over the wire/disk + high serialization costs.

Therefore, I'm proposing to improve the support for GenericRecord in Flink by shipping the schema to each serializer through the AvroTypeInformation.
Then, we can only support GenericRecords with the same type per stream, but the performance will be much better.

Issue Links

• links to: GitHub Pull Request #4943