Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9813

Build xTableSource from Avro schemas

    XMLWordPrintableJSON

    Details

    • Type: Wish
    • Status: Open
    • Priority: Trivial
    • Resolution: Unresolved
    • Affects Version/s: 1.5.0
    • Fix Version/s: None
    • Component/s: Table SQL / Ecosystem
    • Labels:
      None

      Description

      As Avro provide efficient data schemas formalism, it may be great to be able to build Flink Tables Sources with such files.

      More info about Avro schemas :https://avro.apache.org/docs/1.8.1/spec.html#schemas

      For instance, with CsvTableSource :

      Parser schemaParser = new Schema.Parser();

      Schema tableSchema = schemaParser.parse("avro.json");

      Builder bld = CsvTableSource.builder().schema(tableSchema);

       

      This would give me a fully available CsvTableSource with columns defined in avro.json

      It may be possible to do so for every TableSources since avro format is really common and versatile.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              flacombe François Lacombe
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 48h
                48h
                Remaining:
                Remaining Estimate - 48h
                48h
                Logged:
                Time Spent - Not Specified
                Not Specified