Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9794

JMX metrics produce higher memory and CPU consumption in Kafka docker

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.2.0
    • Fix Version/s: None
    • Component/s: metrics
    • Labels:
    • Environment:
      kafka version: kafka_2.12-2.2.0.tgz using docker

      Description

      We have implemented the Kafka metrics using this github: https://github.com/oded-dd/prometheus-jmx-kafka

      we have enabled the metrics using KAFKA_OPTS. export KAFKA_OPTS='-javaagent:/etc/kafka/jmx_prometheus_javaagent-0.3.1.jar=9097:/etc/kafka/kafka-jmx-metrics.yaml'

      After starting the Kafka with this, we have seen high usage in CPU and memory shoot up in the docker

      CPU cycles goes some times as up as 300% , we are running with 4 cpu's  Kindly suggest some solution how to fix this.

        Attachments

        1. threadDumpKafka.txt
          69 kB
          Brajesh

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              shari20 Hariprasad
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: