[KAFKA-6166] Streams configuration requires consumer. and producer. in order to be read

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.11.0.0
• Fix Version/s: 1.0.1, 1.1.0
• Component/s: streams
• Labels: newbie++ user-experience
• Environment: Kafka 0.11.0.0 ; JDK 1.8 ; CoreOS
• Assignee: Filipe Agapito
• Reporter: Justin Manchester
• Created: 03/Nov/17 10:48
• Updated: 30/Jan/18 22:14
• Resolved: 30/Jan/18 18:40

Description

Problem:

In previous release you could specify a custom metrics reporter like so:

Properties config = new Properties();
config.put(StreamsConfig.BOOTSTRAP_SERVERS_CONFIG, "kafka-broker1:9092");
config.put(StreamsConfig.METRIC_REPORTER_CLASSES_CONFIG, "com.mycompany.MetricReporter");
config.put("custom-key-for-metric-reporter", "value");

From 0.11.0.0 onwards this is no longer possible, as you have to specify consumer.custom-key-for-metric-reporter or producer.custom-key-for-metric-reporter otherwise it's stripped out of the configuration.

So, if you wish to use a metrics reporter and to collect producer and consumer metrics, as well as kafka-streams metrics, that you would need to specify 3 distinct configs:

1) consumer.custom-key-for-metric-reporter
2) producer.custom-key-for-metric-reporter
3) custom-key-for-metric-reporter

This appears to be a regression.

Issue Links

• links to: GitHub Pull Request #4434
• links to: GitHub Pull Request #4489