[FLINK-19339] Support Avro's unions with logical types

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.10.3, 1.11.3, 1.12.0
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Labels: pull-request-available
• Assignee: Dawid Wysakowicz
• Reporter: Dawid Wysakowicz
• Created: 22/Sep/20 06:53
• Updated: 19/Feb/21 07:28
• Resolved: 09/Oct/20 06:38

Description

Avro 1.9.x introduced yet another mechanism for registering/looking up conversions for logical types. See https://issues.apache.org/jira/browse/AVRO-1891

If a logical type is part of a union a static field MODEL$ of type SpecificData will be added to the generated Avro class with registered conversions for a logical type. We should use that SpecificData in AvroSerializer and Avro(De)SerializationSchema whenever available.

Issue Links

• causes: FLINK-19439 Performance regression on 24.09.2020
• links to: GitHub Pull Request #13450