Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-9597

Autodetect Avro schema from Avro file

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • io-java-avro
    • None

    Description

      I'm building a pipeline where I'm reading a set of Avro files, all with same schema. These Avro contains the schema definition. To get GenericRecords, I today have to specify the schema for the files in my pipeline. It would be very neat to use the fact that my Avro files contains the schema definition already. Something like 
      AvroIO.readFilesGenericRecordsParseSchemaFromSource().

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            lazlo Lars Almgren

            Dates

              Created:
              Updated:

              Slack

                Issue deployment