[FLINK-4777] ContinuousFileMonitoringFunction may throw IOException when files are moved

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.1.2, 1.2.0
• Fix Version/s: 1.1.3, 1.2.0
• Component/s: Connectors / Common
• Assignee: Maximilian Michels
• Reporter: Maximilian Michels
• Created: 07/Oct/16 18:10
• Updated: 10/Oct/16 09:03
• Resolved: 10/Oct/16 09:03

Description

FileSystem.listStatus(path) may throw an IOException when it lists files and then retrieves their file status. This is quite common, e.g. editors which create temporary files and move them. The ContinuousFileMonitoringFunction can only apply a file path filter afterwards. Thus, this problem can't easily be avoided and needs to be taken care of by the function itself.

Issue Links

• links to: GitHub Pull Request #2610