Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2491 Support Checkpoints After Tasks Finished
  3. FLINK-23512

Check for illegal modifications of JobGraph with partially finished operators

    XMLWordPrintableJSON

    Details

      Description

      Besides the fully finished operators, we also would like to disable inserting new operators before the partially finished operators:

      1. If keyed state is used and discarded after the tasks get finished in the first run, then if we received new records target at these keys, the result would be not right.
      2. Similarly, for normal operator subtasks, if new records are emitted and they relies on the discarded states, the result would also be confused. 

      Thus we would first disable such cases. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gaoyunhaii Yun Gao
                Reporter:
                gaoyunhaii Yun Gao
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: