[KAFKA-4702] Parametrize streams benchmarks to run at scale

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.11.0.0
• Fix Version/s: 0.11.0.0
• Component/s: streams
• Assignee: Eno Thereska
• Reporter: Eno Thereska
• Created: 26/Jan/17 16:41
• Updated: 08/Feb/17 21:06
• Resolved: 08/Feb/17 21:06

Description

The streams benchmarks (in SimpleBenchmark.java and triggered through kafka/tests/kafkatest/benchmarks/streams/streams_simple_benchmark_test.py) run as single-instance, with a simple 1 broker Kafka cluster.

We need to parametrize the tests so they can run at scale, e.g., with 10-100 KafkaStreams instances and similar number of brokers.

Issue Links

• links to: GitHub Pull Request #2478