Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2491 Checkpointing only works if all operators/tasks are still running
  3. FLINK-21066

Refactor the CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically

    XMLWordPrintableJSON

    Details

      Description

      Currently Flink would identify the tasks to trigger/wait/commit in compile phase, and pass them to the CheckpointCoordinator via JobGraph and cache them in CheckpointCoordinator. However, to support checkpoint after some tasks finished, we might need to recompute the tasks to trigger/wait/commit for each checkpoint, thus we would first refactor CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically, but keeps the computing logic unchange (e.g., tasks to trigger are source tasks and tasks to wait/commit are all tasks)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gaoyunhaii Yun Gao
                Reporter:
                gaoyunhaii Yun Gao
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: