Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-12576

inputQueueLength metric does not work for LocalInputChannels

    XMLWordPrintableJSON

    Details

      Description

      Currently inputQueueLength ignores LocalInputChannels (SingleInputGate#getNumberOfQueuedBuffers). This can can cause mistakes when looking for causes of back pressure (If task is back pressuring whole Flink job, but there is a data skew and only local input channels are being used).

        Attachments

        1. Screen Shot 2019-09-24 at 3.22.36 PM.png
          683 kB
          David Anderson
        2. Screen Shot 2019-09-24 at 3.22.53 PM.png
          413 kB
          David Anderson
        3. Screen Shot 2019-09-24 at 3.13.05 PM.png
          431 kB
          David Anderson
        4. Screen Shot 2019-09-24 at 3.11.15 PM.png
          503 kB
          David Anderson
        5. flink-1.8-2-single-slot-TMs-output.png
          171 kB
          David Anderson
        6. flink-1.8-2-single-slot-TMs-input.png
          176 kB
          David Anderson
        7. flink-1.8-output-subtasks.png
          88 kB
          David Anderson
        8. flink-1.8-input-subtasks.png
          89 kB
          David Anderson
        9. image-2019-09-26-11-34-24-878.png
          165 kB
          Yingjie Cao
        10. image-2019-09-26-11-36-06-027.png
          56 kB
          Yingjie Cao

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                pnowojski Piotr Nowojski
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m