Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1398

KafkaIO metrics

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • P2
    • Resolution: Implemented
    • None
    • 2.0.0
    • io-java-kafka
    • None

    Description

      Add metrics to KafkaIO using the metrics API.

      Metrics (Feel free to add more ideas here) per split (Where applicable):

      • Backlog in bytes.
      • Backlog in number of messages.
      • Messages consumed.
      • Bytes consumed.
      • Messages produced.

      Add NeedsRunner test which creates a pipeline and asserts metrics values.

      Attachments

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue BEAM-1617 Add Gauge metric type to Java SDK

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

          Sub-task - The sub-task of the issue BEAM-1958 Standard IO Metrics in Java SDK

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. BEAM-1397 Introduce IO metrics

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-1126 Expose UnboundedSource split backlog in number of events

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          links to

          Web Link GitHub Pull Request #2344

          Activity

            People

              aviemzur Aviem Zur
              aviemzur Aviem Zur
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: