Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6166

Streams configuration requires consumer. and producer. in order to be read

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.11.0.0
    • Fix Version/s: 1.1.0, 1.0.1
    • Component/s: streams
    • Environment:
      Kafka 0.11.0.0
      JDK 1.8
      CoreOS

      Description

      Problem:

      In previous release you could specify a custom metrics reporter like so:

      Properties config = new Properties();
      config.put(StreamsConfig.BOOTSTRAP_SERVERS_CONFIG, "kafka-broker1:9092");
      config.put(StreamsConfig.METRIC_REPORTER_CLASSES_CONFIG, "com.mycompany.MetricReporter");
      config.put("custom-key-for-metric-reporter", "value");

      From 0.11.0.0 onwards this is no longer possible, as you have to specify consumer.custom-key-for-metric-reporter or producer.custom-key-for-metric-reporter otherwise it's stripped out of the configuration.

      So, if you wish to use a metrics reporter and to collect producer and consumer metrics, as well as kafka-streams metrics, that you would need to specify 3 distinct configs:

      1) consumer.custom-key-for-metric-reporter
      2) producer.custom-key-for-metric-reporter
      3) custom-key-for-metric-reporter

      This appears to be a regression.

        Attachments

          Activity

            People

            • Assignee:
              h314to Filipe Agapito
              Reporter:
              Juma Justin Manchester
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: