[FLINK-12501] AvroTypeSerializer does not work with types generated by avrohugger

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.9.1, 1.10.0
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Labels: pull-request-available
• Assignee: Aljoscha Krettek
• Reporter: Aljoscha Krettek
• Created: 13/May/19 14:06
• Updated: 09/Jul/20 14:50
• Resolved: 06/Sep/19 11:22

Description

The main problem is that the code in SpecificData.createSchema() tries to reflectively read the SCHEMA$ field, that is normally there in Avro generated classes. However, avrohugger generates this field in a companion object, which the reflective Java code will therefore not find.

This is also described in these ML threads:

• https://lists.apache.org/thread.html/5db58c7d15e4e9aaa515f935be3b342fe036e97d32e1fb0f0d1797ee@%3Cuser.flink.apache.org%3E
• https://lists.apache.org/thread.html/cf1c5b8fa7f095739438807de9f2497e04ffe55237c5dea83355112d@%3Cuser.flink.apache.org%3E

Issue Links

• is cloned by: FLINK-18478 AvroDeserializationSchema does not work with types generated by avrohugger
• links to: GitHub Pull Request #9565
• links to: PR 9565