To test unaligned checkpoints, we should use a few different applications that use different features.
The sinks should not be mocked but rather should be able to induce a fair amount of backpressure into the system. Quite possibly, it would be a good idea to have a way to add more backpressure to the sink by running the respective system on the cluster and be able to add/remove parallel instances.
The primary objective is to check if all data is recovered properly and if the semantics is correct (does state match input?).
The secondary objective is to check if Flink UI shows the information correctly.
More details in the subtasks.
|Device application for unaligned checkpoint test on cluster||Resolved|
|Execute unaligned checkpoint test on a cluster||Open||Unassigned|