Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3769

KStream job spending 60% of time writing metrics

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.10.0.0
    • 0.10.1.0
    • streams
    • None
    • Patch

    Description

      I've been profiling a complex streams job, and found two major hotspots when writing metrics, which take up about 60% of the CPU time of the job. A PR is attached.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-3826 Sampling on throughput / latency metrics recording in Streams

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-3785 Fetcher spending unnecessary time during metrics recording

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #1447

          Web Link GitHub Pull Request #1490

          Web Link GitHub Pull Request #1530

          Activity

            People

              guozhang Guozhang Wang
              gfodor Greg Fodor
              Guozhang Wang Guozhang Wang
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: