[FLINK-27415] Read empty csv file throws exception in FileSystem table connector

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.18.0, 1.16.3, 1.17.2
• Component/s: Connectors / FileSystem, Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Labels: pull-request-available stale-assigned
• Assignee: jia liu
• Reporter: Jingsong Lee
• Created: 26/Apr/22 10:54
• Updated: 06/Jul/23 13:40
• Resolved: 06/Jul/23 13:40

Description

// in CsvFilesystemBatchITCase
@Test
public void testEmpty() throws Exception {
    String path = new URI(resultPath()).getPath();
    new File(path).mkdirs();
    File file = new File(path, "test_file");
    file.createNewFile();

    check("select * from nonPartitionedTable", Collections.emptyList());
} 

Throws:

Caused by: java.lang.IllegalArgumentException
    at org.apache.flink.util.Preconditions.checkArgument(Preconditions.java:122)
    at org.apache.flink.connector.file.src.impl.StreamFormatAdapter$TrackingFsDataInputStream.<init>(StreamFormatAdapter.java:264)
    at org.apache.flink.connector.file.src.impl.StreamFormatAdapter.lambda$openStream$3(StreamFormatAdapter.java:180)
    at org.apache.flink.connector.file.src.util.Utils.doWithCleanupOnException(Utils.java:45)
    at org.apache.flink.connector.file.src.impl.StreamFormatAdapter.openStream(StreamFormatAdapter.java:172)
    at org.apache.flink.connector.file.src.impl.StreamFormatAdapter.createReader(StreamFormatAdapter.java:70)
    at org.apache.flink.connector.file.src.impl.FileSourceSplitReader.checkSplitOrStartNext(FileSourceSplitReader.java:112)
    at org.apache.flink.connector.file.src.impl.FileSourceSplitReader.fetch(FileSourceSplitReader.java:65)
    at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
    at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:142)
    ... 6 more 

This may be introduced by FLINK-24703 

Issue Links

• causes: FLINK-32539 Archunit violations started to fail in test_misc
• links to: GitHub Pull Request #20006
• links to: GitHub Pull Request #22961
• links to: GitHub Pull Request #22962