[FLINK-17133] Support CsvParser Features for CSV format via SQL DDL

• Type: New Feature
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
• Labels: auto-deprioritized-major auto-deprioritized-minor pull-request-available
• Assignee: Unassigned
• Reporter: Kai Chen
• Created: 14/Apr/20 09:43
• Updated: 17/Apr/22 10:38

Description

Should we support CsvParser Features for RFC-compliant CSV format via SQL DDL? 

All CsvParser Features list in

https://fasterxml.github.io/jackson-dataformats-text/javadoc/csv/2.10/com/fasterxml/jackson/dataformat/csv/CsvParser.Feature.html

Such as :

IGNORE_TRAILING_UNMAPPABLE

SKIP_EMPTY_LINES

FAIL_ON_MISSING_COLUMNS

...

 

Issue Links

• is related to: FLINK-21583 Allow comments in CSV format without having to ignore parse errors
• relates to: FLINK-21562 Add more informative message on CSV parsing errors
• links to: GitHub Pull Request #11744
• links to: GitHub Pull Request #11745