[KAFKA-1190] create a draw performance graph script

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Assignee: Unassigned
• Reporter: Joe Stein
• Created: 23/Dec/13 22:02
• Updated: 24/May/16 20:56
• Resolved: 24/May/16 20:56

Description

This will be an R script to draw relevant graphs given a bunch of csv files from the above tools. The output of this script will be a bunch of png files that can be combined with some html to act as a perf report.

Here are the graphs that would be good to see:

• Latency histogram for producer
• MB/sec and messages/sec produced
• MB/sec and messages/sec consumed
• Flush time
• Errors (should not be any)
• Consumer cache hit ratio (both the bytes and count, specifically 1
  #physical_reads / #requests and 1 - physical_bytes_read / bytes_read)
• Write merge ratio (num_physical_writes/num_produce_requests and avg_request_size/avg_physical_write_size)
  CPU, network, io, etc