Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15637

For RocksDBStateBackend, make RocksDB the default store for timers

    XMLWordPrintableJSON

Details

    • Hide
      After FLINK-15637, we change the default timer store from heap to RocksDB for RocksDBStateBackend to support asynchronous snapshots for timer state and better scalability, with less than 5% performance cost. If you find the performance decline critical, please set "state.backend.rocksdb.timer-service.factory" to "HEAP" in flink-conf.yaml to restore the old behavior.
      Show
      After FLINK-15637 , we change the default timer store from heap to RocksDB for RocksDBStateBackend to support asynchronous snapshots for timer state and better scalability, with less than 5% performance cost. If you find the performance decline critical, please set "state.backend.rocksdb.timer-service.factory" to "HEAP" in flink-conf.yaml to restore the old behavior.

    Description

      Set the state.backend.rocksdb.timer-service.factory to ROCKSDB by default. Also ensure that the programmatic default value becomes the same.

      We need to update the performance tuning guide to mention this.
       
      We need to update the release notes to mention this.

      This is a decision concluded from ML discussion (as well as a twitter vote).

       

      Attachments

        Issue Links

          Activity

            People

              klion26 Congxian Qiu
              sewen Stephan Ewen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m