[FLINK-3777] Add open and close methods to manage IF lifecycle

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.1
• Labels: inputformat lifecycle
• Assignee: Flavio Pompermaier
• Reporter: Flavio Pompermaier
• Created: 18/Apr/16 10:04
• Updated: 28/Feb/19 13:20
• Resolved: 26/Apr/16 14:01

Description

At the moment the opening and closing of an inputFormat are not managed, although open() could be (improperly IMHO) simulated by configure().
This limits the possibility to reuse expensive resources (like database connections) and manage their release.

Probably the best option would be to add 2 methods (i.e. openInputformat() and closeInputFormat() ) to RichInputFormat*

• NOTE: the best option from a "semantic" point of view would be to rename the current open() and close() to openSplit() and closeSplit() respectively while using open() and close() methods for the IF lifecycle management, but this would cause a backward compatibility issue...

Issue Links

• blocks: FLINK-3750 Make JDBCInputFormat a parallel source