[FLINK-7406] Implement Netty receiver incoming pipeline for credit-based

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: Runtime / Network
• Assignee: Zhijiang
• Reporter: Zhijiang
• Created: 10/Aug/17 03:49
• Updated: 09/Jan/18 01:50
• Resolved: 08/Jan/18 13:41

Description

This is a part of work for credit-based network flow control.

Currently PartitionRequestClientHandler receives and reads BufferResponse from producer. It will request buffer from BufferPool for holding the message. If not got, the message is staged temporarily and autoread for channel is set false.

For credit-based mode, PartitionRequestClientHandler can always get buffer from RemoteInputChannel for reading messages from producer.

The related works are:

• Add the backlog of producer in BufferResponse message structure
• PartitionRequestClientHandler requests buffer from RemoteInputChannel directly
• PartitionRequestClientHandler updates backlog for RemoteInputChannel, and it may trigger requests of floating buffers from BufferPool

Issue Links

• links to: GitHub Pull Request #4509