[FLINK-9813] Build xTableSource from Avro schemas

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.5.0
• Component/s: Table SQL / Ecosystem
• Assignee: Unassigned
• Reporter: François Lacombe
• Created: 11/Jul/18 17:04
• Updated: 12/Apr/21 10:10

Description

As Avro provide efficient data schemas formalism, it may be great to be able to build Flink Tables Sources with such files.

More info about Avro schemas :https://avro.apache.org/docs/1.8.1/spec.html#schemas

For instance, with CsvTableSource :

Parser schemaParser = new Schema.Parser();

Schema tableSchema = schemaParser.parse("avro.json");

Builder bld = CsvTableSource.builder().schema(tableSchema);

 

This would give me a fully available CsvTableSource with columns defined in avro.json

It may be possible to do so for every TableSources since avro format is really common and versatile.