Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7282 Credit-based Network Flow Control
  3. FLINK-7406

Implement Netty receiver incoming pipeline for credit-based

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: Runtime / Network
    • Labels:
      None

      Description

      This is a part of work for credit-based network flow control.

      Currently PartitionRequestClientHandler receives and reads BufferResponse from producer. It will request buffer from BufferPool for holding the message. If not got, the message is staged temporarily and autoread for channel is set false.

      For credit-based mode, PartitionRequestClientHandler can always get buffer from RemoteInputChannel for reading messages from producer.

      The related works are:

      • Add the backlog of producer in BufferResponse message structure
      • PartitionRequestClientHandler requests buffer from RemoteInputChannel directly
      • PartitionRequestClientHandler updates backlog for RemoteInputChannel, and it may trigger requests of floating buffers from BufferPool

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zjwang Zhijiang
                Reporter:
                zjwang Zhijiang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: