[FLINK-24470] EMA for buffer debloat level

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.15.0
• Component/s: Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Anton Kalashnikov
• Reporter: Anton Kalashnikov
• Created: 07/Oct/21 09:34
• Updated: 03/Nov/21 16:27
• Resolved: 28/Oct/21 12:19

Description

Right now, we use EMA for the smoothing calculation of the throughput. But there is an idea to use EMA on the buffer debloat(BufferDebloater) level because it contains more information(old buffer size, current throughput, buffer in use count, etc.) and it looks like it should be used more effectively.

!NB. This is just an idea which makes sense to try. but if the new implementation doesn't have real profit it makes sense to keep the old one.

Issue Links

• blocks: FLINK-24551 BUFFER_DEBLOAT_SAMPLES property is taken from the wrong configuration
• Dependent: FLINK-23974 Decreased throughput with enabled buffer debloat
• links to: GitHub Pull Request #17473