[FLINK-24630] Implement row projection in AvroToRowDataConverters#createRowConverter

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.15.0
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Labels: auto-deprioritized-major auto-deprioritized-minor pull-request-available
• Assignee: Unassigned
• Reporter: Caizhi Weng
• Created: 25/Oct/21 09:51
• Updated: 12/Jul/22 22:37

Description

Currently AvroToRowDataConverters#createRowConverter converts avro records to Flink row data directly without any projection. However users of this method, such as AvroFileSystemFormatFactory.RowDataAvroInputFormat, need to implement their own projection logic to filter out the columns they needed.

We can hide the logic of implementation in AvroToRowDataConverters#createRowConverter both for optimization (users do not need to copy the row for this) and for the ease of coding.

Issue Links

• links to: GitHub Pull Request #17565