[FLINK-7468] Implement sender backlog logic for credit-based - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.5.0
Component/s: Runtime / Network
Labels:
None

Description

This is a part of work for credit-based network flow control.

Receivers should know how many buffers are available on the sender side (the backlog). The receivers use this information to decide how to distribute floating buffers.

The ResultSubpartition maintains the backlog which only indicates the number of buffers in this subpartition, not including the number of events. The backlog is increased for adding buffer to this subpartition, and decreased for polling buffer from it.

The backlog is attached in BufferResponse by sender as an absolute value after the buffer being transferred.