[SAMZA-566] Improve Kafka performance test

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Component/s: kafka, test
• Assignee: Unassigned
• Reporter: Chris Riccomini
• Created: 14/Feb/15 02:30
• Updated: 17/Feb/15 18:53

Description

SAMZA-548 added a Kafka performance test to Samza's integration test suite. The test is currently pretty basic. We should:

1. Support test execution on more brokers.
2. Test with a topic that has a higher replication factor.
3. Test with more than 1 million messages.
4. Validate some minimum level of performance (e.g. the test must run faster than N messages/sec, or N MB/sec).
5. Test with different compression and linger settings.

The goal is to make the test have similar characteristics to this Kafka test.

Issue Links

• is related to: SAMZA-548 Add performance test for container Kafka performance