[SAMZA-6] Create a performance test suite

• Type: Test
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.6.0
• Component/s: test
• Labels: gsoc2015 java project
• Assignee: David Chen
• Reporter: Chris Riccomini
• Created: 12/Aug/13 03:43
• Updated: 23/Mar/15 03:58

Description

We don't really have an performance metrics at this point. There is a single performance test in the samza-test package, but it would be nice to auto-generate a report that measures things like performance of state restore, max mb/s, max msgs/sec, etc. Kafka's perf suite is a useful guideline:

https://cwiki.apache.org/confluence/display/KAFKA/Performance+testing

Issue Links

• relates to: SAMZA-14 Fix misc bugs in QA jobs
• relates to: SAMZA-548 Add performance test for container Kafka performance

Sub-Tasks

• Fix existing integration test suite under samza-test: Resolved
• Design doc for new integration/performance test suite: In Progress