Right now there are some caveats to the new Source API. From the implementation of some connectors. We would like to make the following improvements to the current Source API.
- Add the following method to the SplitReader API.
public void close() throws Exception；
This method allows the SplitReader implementations to be closed properly when the split fetcher exits.
- Add the following method to the SourceReader API.
public void checkpointComplete(long checkpointId);
This method allows the SourceReader to take some cleanup / reporting actions when a checkpoint has been successfully taken.