Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-23399

Add a performance benchmark for statebackend rescaling

    XMLWordPrintableJSON

    Details

      Description

      We notice that rescaling is not covered in the current state benchmark, so we'd like to introduce a benchmark to test performance of state backend restore durign rescaling in flink-benchmark.

      The benchmark process is:

      (1) generate some states,

      (2) change the parallelism of the operator, and restore from these states generate before.

      The implementation of this benchmark is based on RocksIncrementalCheckpointRescalingTest, and AverageTime is used to measure the rescaling performance on each subtask.

       

      And this benchmark does not conflict with `RocksIncrementalCheckpointRescalingBenchmarkTest` in 
      PR(#14893). Compare with `RocksIncrementalCheckpointRescalingBenchmarkTest`, this benchmark supports testing rescaling on different state backends, and has a finer granularity.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Yanfei Lei Yanfei Lei
                Reporter:
                Yanfei Lei Yanfei Lei
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: