[FLINK-23459] New metrics for dynamic buffer size

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Component/s: Runtime / Metrics, Runtime / Network
• Assignee: Piotr Nowojski
• Reporter: Anton Kalashnikov
• Created: 21/Jul/21 12:52
• Updated: 06/Aug/21 16:45
• Resolved: 06/Aug/21 16:44

Description

The following metrics can be added:

• The total size of buffered in-flight data (both detailed per gate + sum per subtask)

• Total estimated time to process the data (both detailed per gate + max per subtask)

• Actual value of the calculated dynamic buffer size (only detailed per gate)

All of those metrics should be exposed only on the input side, taking into account only input in-flight data.