Details

    • Hide
      This release introduces a new format descriptor for CSV files that is compliant
      with RFC 4180. The new descriptor is available as
      `org.apache.flink.table.descriptors.Csv`. For now, this can only be used
      together with the Kafka connector. The old descriptor is availabla as
      `org.apache.flink.table.descriptors.OldCsv` for use with file system connectors.
      Show
      This release introduces a new format descriptor for CSV files that is compliant with RFC 4180. The new descriptor is available as `org.apache.flink.table.descriptors.Csv`. For now, this can only be used together with the Kafka connector. The old descriptor is availabla as `org.apache.flink.table.descriptors.OldCsv` for use with file system connectors.

    Description

      We should add a RFC 4180 compliant CSV table format factory to read and write data into Kafka and other connectors. This requires a SerializationSchemaFactory and DeserializationSchemaFactory. How we want to represent all data types and nested types is still up for discussion. For example, we could flatten and deflatten nested types as it is done here. We can also have a look how tools such as the Avro to CSV tool perform the conversion.

      Attachments

        Activity

          People

            wind_ljy Jiayi Liao
            twalthr Timo Walther
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 0.5h
                0.5h