Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3310

Add back pressure statistics to web frontend

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Implemented
    • None
    • 1.0.0
    • Runtime / Web Frontend
    • None

    Description

      When a task is receiving data at a higher rate than it can process, the task is back pressuring preceding tasks. Currently, there is no way to tell whether this is the case or not. An indicator for back pressure is tasks being stuck in buffer requests on the network stack. This means that they have filled all their buffers with data, but the following tasks/network are not consuming them fast enough.

      A simple way to measure back pressure is to sample running tasks and report back pressure if they are stuck in the blocking buffers calls.

      Attachments

        Issue Links

          Activity

            People

              uce Ufuk Celebi
              uce Ufuk Celebi
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: