[SPARK-24800] Refactor Avro Serializer and Deserializer

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.0
• Component/s: SQL
• Assignee: Gengliang Wang
• Reporter: Gengliang Wang
• Created: 13/Jul/18 16:36
• Updated: 17/Sep/18 16:02
• Resolved: 15/Jul/18 14:07

Description

Currently in Avro data source module, the Avro Deserializer converts input Avro format data to Row, and then convert the Row to InternalRow. The Avro Serializer converts InternalRow to Row, and then output Avro format data. To improve the performance, we need to make a direct conversion between InternalRow and Avro format data.

Issue Links

• links to: [Github] Pull Request #21762 (gengliangwang)