[FLINK-20276] Transparent DeCompression of streams missing on new File Source

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: Connectors / FileSystem
• Assignee: Stephan Ewen
• Reporter: Stephan Ewen
• Created: 22/Nov/20 16:19
• Updated: 22/Nov/20 22:55
• Resolved: 22/Nov/20 19:59

Description

The existing FileInputFormat applies decompression (gzip, xy, ...) automatically on the file input stream, based on the file extension.

We need to add similar functionality for the StreamRecordFormat of the new FileSource to be on par with this functionality.

This can be easily applied in the StreamFormatAdapter when opening the file stream.