Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7282 Credit-based Network Flow Control
  3. FLINK-9253

Make buffer count per InputGate always #channels*buffersPerChannel + ExclusiveBuffers

    XMLWordPrintableJSON

Details

    Description

      The credit-based flow control path assigns exclusive buffers only to remote channels (which makes sense since local channels don't use any own buffers). However, this is a bit intransparent with respect to how much data may be in buffers since this depends on the actual schedule of the job and not the job graph.

      By adapting the floating buffers to use a maximum of #channels*buffersPerChannel + floatingBuffersPerGate - #exclusiveBuffers, we would be channel-type agnostic and keep the old behaviour.

      Attachments

        Activity

          People

            nkruber Nico Kruber
            nkruber Nico Kruber
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 10m
                10m