Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6166

Streams configuration requires consumer. and producer. in order to be read

Agile BoardAttach filesAttach ScreenshotVotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.11.0.0
    • 1.0.1, 1.1.0
    • streams
    • Kafka 0.11.0.0
      JDK 1.8
      CoreOS

    Description

      Problem:

      In previous release you could specify a custom metrics reporter like so:

      Properties config = new Properties();
      config.put(StreamsConfig.BOOTSTRAP_SERVERS_CONFIG, "kafka-broker1:9092");
      config.put(StreamsConfig.METRIC_REPORTER_CLASSES_CONFIG, "com.mycompany.MetricReporter");
      config.put("custom-key-for-metric-reporter", "value");

      From 0.11.0.0 onwards this is no longer possible, as you have to specify consumer.custom-key-for-metric-reporter or producer.custom-key-for-metric-reporter otherwise it's stripped out of the configuration.

      So, if you wish to use a metrics reporter and to collect producer and consumer metrics, as well as kafka-streams metrics, that you would need to specify 3 distinct configs:

      1) consumer.custom-key-for-metric-reporter
      2) producer.custom-key-for-metric-reporter
      3) custom-key-for-metric-reporter

      This appears to be a regression.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            h314to Filipe Agapito
            Juma Justin Manchester
            Votes:
            0 Vote for this issue
            Watchers:
            8 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment