Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15637

For RocksDBStateBackend, make RocksDB the default store for timers

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Hide
      After FLINK-15637, we change the default timer store from heap to RocksDB for RocksDBStateBackend to support asynchronous snapshots for timer state and better scalability, with less than 5% performance cost. If you find the performance decline critical, please set "state.backend.rocksdb.timer-service.factory" to "HEAP" in flink-conf.yaml to restore the old behavior.
      Show
      After FLINK-15637 , we change the default timer store from heap to RocksDB for RocksDBStateBackend to support asynchronous snapshots for timer state and better scalability, with less than 5% performance cost. If you find the performance decline critical, please set "state.backend.rocksdb.timer-service.factory" to "HEAP" in flink-conf.yaml to restore the old behavior.

    Description

      Set the state.backend.rocksdb.timer-service.factory to ROCKSDB by default. Also ensure that the programmatic default value becomes the same.

      We need to update the performance tuning guide to mention this.
       
      We need to update the release notes to mention this.

      This is a decision concluded from ML discussion (as well as a twitter vote).

       

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            klion26 Congxian Qiu
            sewen Stephan Ewen
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                Slack

                  Issue deployment