Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-541

Use metrics CSV reporter instead of jmx tool for system tests

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.0
    • None
    • None
    • None

    Description

      The existing system test framework spawns off a bunch of jmxtool processes to collect metrics. This is rather heavy-weight and also, requires advance knowledge of all the beans (many of which are dynamically registered). E.g., per-topic stats pop-up only after the topics are produced to.

      Since we are using metrics-core, we can just turn on the CSV reporter to collect these stats. I had originally thought version 2.1.3 had various bugs that rendered it unusable for CSV reporter, but I gave it another try and it seems to be fine. Will post some output.

      Attachments

        1. kafka_541_v1.diff
          13 kB
          Yang Ye
        2. kafka_541_v2.diff
          23 kB
          Yang Ye
        3. metrics-core-3.0.1.jar
          80 kB
          Yang Ye
        4. metrics-annotation-3.0.1.jar
          5 kB
          Yang Ye
        5. kafka_541_v3.diff
          36 kB
          Yang Ye

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-542 Upgrade to metrics 3.x

          • Major - Major loss of function.
          • Closed

          Activity

            People

              yeyangever Yang Ye
              jjkoshy Joel Jacob Koshy
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: