Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10653 Introduce Pluggable Shuffle Service Architecture
  3. FLINK-12202

Consider introducing batch metric register in NetworkEnviroment

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Runtime / Metrics, Runtime / Network
    • None

    Description

      As we have some network specific metrics registered in TaskIOMetricGroup (In/OutputBuffersGauge, In/OutputBufferPoolUsageGauge), we can introduce batch metric registering in NetworkEnviroment.registerMetrics(ProxyMetricGroup, partitions, gates), where task passes its TaskIOMetricGroup into ProxyMetricGroup. This way we could break a tie between task and NetworkEnviroment. TaskIOMetricGroup.initializeBufferMetrics, In/OutputBuffersGauge, In/OutputBufferPoolUsageGauge could be moved into NetworkEnviroment.registerMetrics and network code.

      Attachments

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue FLINK-11726 Refactor the creation of ResultPartition and InputGate into NetworkEnvironment

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              zjwang Zhijiang
              azagrebin Andrey Zagrebin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: