[FLINK-30049] CsvBulkWriter is unsupported for S3 FileSystem in streaming sink

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.16.0, 1.15.2
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Assignee: Unassigned
• Reporter: Jingsong Lee
• Created: 17/Nov/22 02:49
• Updated: 17/Nov/22 02:50

Description

Caused by: org.apache.flink.util.SerializedThrowable: Cannot sync state to system like S3. Use persist() to create a persistent recoverable intermediate point.
	at org.apache.flink.core.fs.RefCountedBufferingFileStream.sync(RefCountedBufferingFileStream.java:111) 
	at org.apache.flink.fs.s3.common.writer.S3RecoverableFsDataOutputStream.sync
	at org.apache.flink.formats.csv.CsvBulkWriter.finish(CsvBulkWriter.java:106) 
	at org.apache.flink.connector.file.table.FileSystemTableSink$ProjectionBulkFactory$1.finish(FileSystemTableSink.java:653) 
	at org.apache.flink.streaming.api.functions.sink.filesystem.BulkPartWriter.closeForCommit(BulkPartWriter.java:64) 

It looks like we should not call `sync` in CsvBulkWriter, we should just use `flush`.