Details

    • Release Note:
      Hide
      This release introduces a new format descriptor for CSV files that is compliant
      with RFC 4180. The new descriptor is available as
      `org.apache.flink.table.descriptors.Csv`. For now, this can only be used
      together with the Kafka connector. The old descriptor is availabla as
      `org.apache.flink.table.descriptors.OldCsv` for use with file system connectors.
      Show
      This release introduces a new format descriptor for CSV files that is compliant with RFC 4180. The new descriptor is available as `org.apache.flink.table.descriptors.Csv`. For now, this can only be used together with the Kafka connector. The old descriptor is availabla as `org.apache.flink.table.descriptors.OldCsv` for use with file system connectors.

      Description

      We should add a RFC 4180 compliant CSV table format factory to read and write data into Kafka and other connectors. This requires a SerializationSchemaFactory and DeserializationSchemaFactory. How we want to represent all data types and nested types is still up for discussion. For example, we could flatten and deflatten nested types as it is done here. We can also have a look how tools such as the Avro to CSV tool perform the conversion.

        Attachments

          Activity

            People

            • Assignee:
              wind_ljy bupt_ljy
              Reporter:
              twalthr Timo Walther
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 0.5h
                0.5h