XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.10.0
    • Fix Version/s: 1.12.0
    • Component/s: Runtime / Web Frontend
    • Labels:
      None

      Description

      According to the Document, the backpressure monitor only triggered on request and it is currently not available via metrics. This means that in the web UI we have no way to show all the backpressure state of all vertexes at the same time. The users need to click every vertex to get its backpressure state.

      In Flink 1.9.0 and above, there are four metrics available(outPoolUsage, inPoolUsage, floatingBuffersUsage, exclusiveBuffersUsage), we can use these metrics to determine if there are possible backpressure, and then use the backpressure REST API to confirm it.

      Here is a table get from https://flink.apache.org/2019/07/23/flink-network-stack-2.html

       

      We can display the possible backpressure status on the vertex graph, thus users can get all the vertex backpressure states and locate the potential problem quickly.

       

       

      REST API needed:

      add outPoolUsage, inPoolUsage, floatingBuffersUsage, exclusiveBuffersUsage metrics for each vertex in the /jobs/:jobId API

        Attachments

        1. 屏幕快照 2019-09-19 下午6.01.43.png
          261 kB
          Yadong Xie
        2. 屏幕快照 2019-09-19 下午6.00.57.png
          400 kB
          Yadong Xie
        3. 屏幕快照 2019-09-19 下午6.00.05.png
          166 kB
          Yadong Xie

          Issue Links

            Activity

              People

              • Assignee:
                vthinkxie Yadong Xie
                Reporter:
                vthinkxie Yadong Xie
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: