Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-6984

Do not recover CompletedCheckpointStore on every restore

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.2.1, 1.3.0, 1.4.0
    • Fix Version/s: 1.12.0
    • Labels:
      None

      Description

      Currently, restoring the latest checkpoint always recovers the CompletedCheckpointStore in CheckpointCoordinator::restoreLatestCheckpointedState(...) by calling completedCheckpointStore.recover(sharedStateRegistry). I think this is not required on every restore, but can happen only once when the JM becomes leader, e.g. when the CheckpointCoordinator is created. This can avoid unnecessary work and simplify the logic, e.g. for populating the SharedStateRegistry, and we could probably also move the ownership for SharedStateRegistry into some AbstractCompletedCheckpontStore.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              wind_ljy Jiayi Liao
              Reporter:
              srichter Stefan Richter

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment