Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-23652

Implement FLIP-179: Expose Standardized Operator Metrics

    XMLWordPrintableJSON

Details

    • Connectors using unified Source and Sink interface expose certain standardized metrics automatically. Applications that use `RuntimeContext#getMetricGroup` need to be rebuild against 1.14 before being submitted to a 1.14 cluster.

    Description

      This ticket is about implementing FLIP-179. It will some metrics out-of-the-box for sources/sinks and supports connector developers to easily implement some standardized metrics.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. FLINK-23913 UnalignedCheckpointITCase fails with exit code 137 (kernel oom) on Azure VMs

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. FLINK-23785 SinkITCase.testMetrics fails with ConcurrentModification on Azure

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. FLINK-23796 UnalignedCheckpointRescaleITCase JVM crash on Azure

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. FLINK-23794 InMemoryReporter leaks memory

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. FLINK-23776 Performance regression on 14.08.2021 in FLIP-27

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          contains

          New Feature - A new feature of the product, which has yet to be developed. FLINK-9050 Expose operator IO counter metrics

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11576 FLIP-33: Standardize connector metrics

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          supercedes

          Sub-task - The sub-task of the issue FLINK-11682 Add abstract source and sink metric classes.

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue FLINK-19743 Add Source metrics definitions

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. FLINK-9050 Expose operator IO counter metrics

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #16770

          Activity

            People

              arvid Arvid Heise
              arvid Arvid Heise
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: