Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14356

Introduce "single-field" format to (de)serialize message to a single field

    XMLWordPrintableJSON

    Details

      Description

      I want to use flink sql to write kafka messages directly to hdfs. The serialization and deserialization of messages are not involved in the middle.  The bytes of the message directly convert the first field of Row.  However, the current RowSerializationSchema does not support the conversion of bytes to VARBINARY. Can we add some special RowSerializationSchema and RowDerializationSchema ? 

      ========================================================================
      Copied from FLINK-9963:

      Sometimes it might be useful to just read or write a single value into Kafka or other connectors. We should add a single-value SerializationSchemaFactory and single-value DeserializationSchemaFactory, the types below and their array types shall be considered.

      byte, short, int, long, float, double, string

      For the numeric types, we might want to specify the endian format.
      A string type single-value format will be added with this issue for future reference.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hackergin jinfeng
                Reporter:
                hackergin jinfeng
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated: