Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7282 Credit-based Network Flow Control
  3. FLINK-7416

Implement Netty receiver outgoing pipeline for credit-based

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: Runtime / Network
    • Labels:
      None

      Description

      This is a part of work for credit-based network flow control.

      The related works are :

      • We define a new message called AddCredit to notify the incremental credit during data shuffle.
      • Whenever an InputChannel’s unannounced credit goes up from zero, the channel is enqueued in the pipeline.
      • Whenever the channel becomes writable, it takes the next InputChannel and sends its unannounced credit. The credit is reset to zero after each sent.
      • That way, messages are sent as often as the network has capacity and contain as much credit as available for the channel at that point in time. Otherwise, it would only add latency to the announcements and not increase throughput.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zjwang Zhijiang
                Reporter:
                zjwang Zhijiang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: