[FLINK-23512] Check for illegal modifications of JobGraph with partially finished operators

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Component/s: Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Yun Gao
• Reporter: Yun Gao
• Created: 27/Jul/21 07:57
• Updated: 20/Aug/21 05:35
• Resolved: 20/Aug/21 05:35

Description

Besides the fully finished operators, we also would like to disable inserting new operators before the partially finished operators:

1. If keyed state is used and discarded after the tasks get finished in the first run, then if we received new records target at these keys, the result would be not right.
2. Similarly, for normal operator subtasks, if new records are emitted and they relies on the discarded states, the result would also be confused. 

Thus we would first disable such cases. 

Issue Links

• is related to: FLINK-23021 Check for illegal modifications of JobGraph with finished operators
• links to: GitHub Pull Request #16655