[FLINK-20286] Support streaming source for filesystem SQL connector

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: Connectors / FileSystem, Table SQL / Ecosystem
• Labels: auto-deprioritized-major pull-request-available
• Assignee: Francesco Guardiani
• Reporter: Jark Wu
• Created: 23/Nov/20 05:16
• Updated: 18/Jan/22 10:21
• Resolved: 18/Jan/22 10:21

Description

Currenlty, the filesystem SQL connector only supports bounded source. It would be great to support streaming read just like Hive connector. It should monitor the new added files and read the content of new files.

Issue Links

• links to: Filesystem as a stream source in Table/SQL API
• links to: GitHub Pull Request #18176