[STORM-642] Add Storm Benchmarking Framework

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: storm-core
• Assignee: P. Taylor Goetz
• Reporter: P. Taylor Goetz
• Created: 30/Jan/15 19:31
• Updated: 05/Oct/15 01:08

Description

(This is intended to be a parent for a multi-task JIRA)

Add a framework for benchmarking Storm topologies and clusters that would capture basic throughput (messages/sec., MB/sec.) and latency metrics.

Allow for the definition of named "benchmark suites" in a configuration file (i.e. YAML) that would define multiple runs of the same benchmark with different tuning parameters (# workers, parallelism hints, etc.). This would allow for easy comparison of different runs to show how different tuning options affect overall performance.

Develop and benchmark both Core Storm and Trident Topologies to illustrate the difference in performance characteristics. Benchmark multiple trident constructs (joins, aggregations, partition(Persist), etc.) to illustrate performance implications.

Document results in a blog post series "Benchmarking Storm" on storm.apache.org/blog.