[FLINK-26311] Test CsvFormat

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Resolved
• Fix Version/s: 1.15.0
• Labels: release-testing
• Assignee: Yun Gao
• Reporter: Alexander Fedulov
• Created: 22/Feb/22 19:56
• Updated: 10/Mar/22 08:24
• Resolved: 10/Mar/22 08:24

Description

https://issues.apache.org/jira/browse/FLINK-24703 adds new implementation for CSV format based on StreamFormat. 

The following needs to be tested:

1. Reading CSV with the DataStream API using FileSource based on POJO schema [1]
2. Reading CSV with the DataStream API using FileSource based on customized schema Jackson (i.e., non-default delimiter)[1]
3. Reading and writing CSV with SQL and 'filesystem' connector, including an option of skipping malformed rows [2]

 

[1] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/formats/csv/

[2] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/formats/csv/