[FLINK-24230] Buffer debloating microbenchmark for single gate

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.15.0
• Component/s: Runtime / Network
• Labels: pull-request-available
• Assignee: Dawid Wysakowicz
• Reporter: Anton Kalashnikov
• Created: 09/Sep/21 13:28
• Updated: 04/Oct/21 15:47
• Resolved: 04/Oct/21 15:47

Description

Currently, there are no microbenchmarks that check buffer debloating effectiveness. The idea is to create one which will measure the checkpoint time. The benchmark should be similar to `UnalignedCheckpointTimeBenchmark` but unlike the `UnalignedCheckpointTimeBenchmark` where we see the effect of `Buffer debloat` only for extremely small values like 1ms for BUFFER_DEBLOAT_TARGET. This benchmark should provide a more reliable way to check the different implementations of `Buffer debloat` it can be reached by increasing at least record size and checkpoint interval. The main target is to have how long will it take to do the checkpoint during backpressure when all buffers are full.

Issue Links

• blocks: FLINK-24231 Buffer debloating microbenchmark for multiply gate
• relates to: FLINK-24280 Support manual checkpoints triggering from a MiniCluster
• links to: GitHub Pull Request #32