[FLINK-7468] Implement sender backlog logic for credit-based

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: Runtime / Network
• Assignee: Zhijiang
• Reporter: Zhijiang
• Created: 17/Aug/17 15:51
• Updated: 17/Jan/18 07:30
• Resolved: 17/Jan/18 07:30

Description

This is a part of work for credit-based network flow control.

Receivers should know how many buffers are available on the sender side (the backlog). The receivers use this information to decide how to distribute floating buffers.

The ResultSubpartition maintains the backlog which only indicates the number of buffers in this subpartition, not including the number of events. The backlog is increased for adding buffer to this subpartition, and decreased for polling buffer from it.

The backlog is attached in BufferResponse by sender as an absolute value after the buffer being transferred.

Issue Links

• links to: GitHub Pull Request #4559