Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15637

For RocksDBStateBackend, make RocksDB the default store for timers

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      After FLINK-15637, we change the default timer store from heap to RocksDB for RocksDBStateBackend to support asynchronous snapshots for timer state and better scalability, with less than 5% performance cost. If you find the performance decline critical, please set "state.backend.rocksdb.timer-service.factory" to "HEAP" in flink-conf.yaml to restore the old behavior.
      Show
      After FLINK-15637 , we change the default timer store from heap to RocksDB for RocksDBStateBackend to support asynchronous snapshots for timer state and better scalability, with less than 5% performance cost. If you find the performance decline critical, please set "state.backend.rocksdb.timer-service.factory" to "HEAP" in flink-conf.yaml to restore the old behavior.

      Description

      Set the state.backend.rocksdb.timer-service.factory to ROCKSDB by default. Also ensure that the programmatic default value becomes the same.

      We need to update the performance tuning guide to mention this.
       
      We need to update the release notes to mention this.

      This is a decision concluded from ML discussion (as well as a twitter vote).

       

        Attachments

          Activity

            People

            • Assignee:
              klion26 Congxian Qiu
              Reporter:
              sewen Stephan Ewen

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                  Issue deployment