Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15637

For RocksDBStateBackend, make RocksDB the default store for timers

    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      After FLINK-15637, we change the default timer store from heap to RocksDB for RocksDBStateBackend to support asynchronous snapshots for timer state and better scalability, with less than 5% performance cost. If you find the performance decline critical, please set "state.backend.rocksdb.timer-service.factory" to "HEAP" in flink-conf.yaml to restore the old behavior.
      Show
      After FLINK-15637 , we change the default timer store from heap to RocksDB for RocksDBStateBackend to support asynchronous snapshots for timer state and better scalability, with less than 5% performance cost. If you find the performance decline critical, please set "state.backend.rocksdb.timer-service.factory" to "HEAP" in flink-conf.yaml to restore the old behavior.

      Description

      Set the state.backend.rocksdb.timer-service.factory to ROCKSDB by default. Also ensure that the programmatic default value becomes the same.

      We need to update the performance tuning guide to mention this.
       
      We need to update the release notes to mention this.

      This is a decision concluded from ML discussion (as well as a twitter vote).

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                klion26 Congxian Qiu(klion26)
                Reporter:
                sewen Stephan Ewen
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m