[FLINK-19698] Add close() method and onCheckpointComplete() to the Source.

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.11.2
• Fix Version/s: 1.12.0, 1.11.3
• Component/s: Connectors / Common
• Labels: pull-request-available
• Assignee: Jiangjie Qin
• Reporter: Jiangjie Qin
• Created: 19/Oct/20 01:21
• Updated: 08/Dec/20 09:44
• Resolved: 08/Dec/20 09:44

Description

Right now there are some caveats to the new Source API. From the implementation of some connectors. We would like to make the following improvements to the current Source API.

1. Add the following method to the SplitReader API.
   public void close() throws Exception；
   This method allows the SplitReader implementations to be closed properly when the split fetcher exits.
2. Add the following method to the SourceReader API.
   public void checkpointComplete(long checkpointId);
   This method allows the SourceReader to take some cleanup / reporting actions when a checkpoint has been successfully taken.

 

 

Issue Links

• links to: GitHub Pull Request #13784