Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3715

Higher granularity streams metrics

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.2.0
    • streams

    Description

      Originally proposed by guozhang in https://github.com/apache/kafka/pull/1362#issuecomment-218326690

      We can consider adding metrics for process / punctuate / commit rate at the granularity of each processor node in addition to the global rate mentioned above. This is very helpful in debugging.

      We can consider adding rate / total cumulated metrics for context.forward indicating how many records were forwarded downstream from this processor node as well. This is helpful in debugging.

      We can consider adding metrics for each stream partition's timestamp. This is helpful in debugging.

      Besides the latency metrics, we can also add throughput latency in terms of source records consumed.

      Attachments

        Issue Links

          Activity

            People

              aartigupta aarti gupta
              jeff.klukas@gmail.com Jeff Klukas
              Eno Thereska Eno Thereska
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: