[FLINK-5812] Clean up FileSystem

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.3.0
• Assignee: Stephan Ewen
• Reporter: Stephan Ewen
• Created: 15/Feb/17 17:43
• Updated: 28/Feb/19 13:20
• Resolved: 20/Feb/17 00:58

Description

The FileSystem class is overloaded and has methods that are not well supported. I suggest to do the following cleanups:

• Pull the safety net into a separate class

• Use the WriteMode to indicate overwriting behavior. Right now, the FileSystem class defines that enum and never uses it. It feels weird.

• Remove the create(path, overwrite, blocksize, reolication, ...) method, which is not really supported across file system implementations. For HDFS, behavior should be set via the configuration anyways.

All changes have to be made in a non-API-breaking fashion.

Issue Links

• links to: GitHub Pull Request #3328