Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-27255

Flink-avro does not support serialization and deserialization of avro schema longer than 65535 characters

    XMLWordPrintableJSON

Details

    Description

      The underlying serialization of avro schema uses string serialization method of ObjectOutputStream.class, however, the default string serialization by ObjectOutputStream.class does not support handling string of more than 66535 characters (64kb). As a result, constructing flink operators that input/output Avro Generic Record with huge schema is not possible.

       

      The purposed fix is two change the serialization and deserialization method of these following classes so that huge string could also be handled.

       

      GenericRecordAvroTypeInfo

      SerializableAvroSchema

       

      Attachments

        Activity

          People

            Keathalin21 Haizhou Zhao
            haizhouz Haizhou Zhao
            Votes:
            2 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: