Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21935

Remove "state.backend.async" option.

Agile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Hide
      The 'state.backend.async' option is deprecated.
      Snapshots are always asynchronous now (as they were by default before) and there is no option to configure a synchronous snapshot any more.

      The constructors of "FsStateBackend" and "MemoryStateBackend" that take a flag for sync/async snapshots are kept for API compatibility, but the flags are ignored now.
      Show
      The 'state.backend.async' option is deprecated. Snapshots are always asynchronous now (as they were by default before) and there is no option to configure a synchronous snapshot any more. The constructors of "FsStateBackend" and "MemoryStateBackend" that take a flag for sync/async snapshots are kept for API compatibility, but the flags are ignored now.

    Description

      Checkpoints are always asynchronous, there is no case ever for a synchronous checkpoint.
      The RocksDB state backend doesn't even support synchronous snapshots, and the HashMap Heap backend also has no good use case for synchronous snapshots (other than a very minor reduction in heap objects).

      Most importantly, we should not expose this option in the constructors of the new state backend API classes, like HashMapStateBackend.

      I marked this a blocker because it is part of the new user-facing State Backend API and I would like to avoid that this option enters this API and causes confusion when we eventually remove it.

      /cc Seth Wiesman and Yu Li

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sewen Stephan Ewen
            sewen Stephan Ewen
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment