[FLINK-12142] Add beforeSnapshot method to StreamOperator interface

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Not A Problem
• Component/s: Runtime / Checkpointing
• Assignee: Unassigned
• Reporter: Gyula Fora
• Created: 09/Apr/19 09:28
• Updated: 13/Apr/21 20:40
• Resolved: 09/Apr/19 09:58

Description

Right now, when a stream task receives a triggerCheckpoint call, it immediately forwards the checkpoint barrier and performs the checkpoint operation under the checkpoint lock.

This mechanism doesn't allow the stream operations to implement any logic that should be performed before the snapshot is triggered in order to ensure state consistency.

Some examples would be:

• Flushing any state (or other kind of) cache that is implemented in the operator layer
• Wait for pending operations (maybe with a different async execution model)

The method could for instance look simply like this in the StreamOperator interface:
default void beforeSnapshot(long checkpointId, long timestamp) throws Exception {}; 

This method should then be called before the barrier is sent downstream still outside the checkpoint lock.