[KAFKA-6657] Add StreamsConfig prefix for different consumers

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Delivered
• Affects Version/s: 1.1.0
• Fix Version/s: 2.0.0
• Component/s: streams
• Labels: beginner needs-kip newbie newbie++
• Assignee: Boyang Chen
• Reporter: Matthias J. Sax
• Created: 14/Mar/18 17:49
• Updated: 15/May/18 20:52
• Resolved: 02/May/18 22:00

Description

Kafka Streams allows to pass in different configs for different clients by prefixing the corresponding parameter with `producer.` or `consumer.`.

However, Kafka Streams internally uses multiple consumers, (1) the main consumer (2) the restore consumer and (3) the global consumer (that is a restore consumer as well atm).

For some use cases, it's required to set different configs for different consumers. Thus, we should add two new prefix for restore and global consumer. We might also consider to extend `KafkaClientSupplier` and add a `getGlobalConsumer()` method.

Issue Links

• supercedes: KAFKA-6723 Separate "max.poll.record" for restore consumer and common consumer
• links to: GitHub Pull Request #4805
• mentioned in: Page Loading...