I want to use flink sql to write kafka messages directly to hdfs. The serialization and deserialization of messages are not involved in the middle. The bytes of the message directly convert the first field of Row. However, the current RowSerializationSchema does not support the conversion of bytes to VARBINARY. Can we add some special RowSerializationSchema and RowDerializationSchema ?
Sometimes it might be useful to just read or write a single value into Kafka or other connectors. We should add a single-value SerializationSchemaFactory and single-value DeserializationSchemaFactory, the types below and their array types shall be considered.
byte, short, int, long, float, double, string
For the numeric types, we might want to specify the endian format.
A string type single-value format will be added with this issue for future reference.