[FLINK-13850] Refactor part file configuration into a single method

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.10.0
• Component/s: Connectors / FileSystem
• Labels: pull-request-available
• Assignee: João Boto
• Reporter: Gyula Fora
• Created: 26/Aug/19 07:48
• Updated: 17/Nov/19 12:32
• Resolved: 17/Nov/19 12:32

Description

Currently there is only two methods on both format builders
withPartFilePrefix and withPartFileSuffix for configuring the part files but in the future it is likely to grow.

• More settings, different directories for pending / inprogress files etc

I suggest we remove these two methods and replace them with a single : withPartFileConfig(..) where we use an extensible config class.

This should be fixed before 1.10 in order to not release the other methods.

Issue Links

• links to: GitHub Pull Request #9533
• links to: GitHub Pull Request #10225