[KAFKA-7289] Performance tools should allow user to specify output type

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0
• Component/s: tools
• Assignee: Attila Sasvári
• Reporter: Attila Sasvári
• Created: 14/Aug/18 12:14
• Updated: 25/Nov/18 03:04

Description

Currently, org.apache.kafka.tools.ProducerPerformance and kafka.tools.ConsumerPerformance do not provide command line options to specify output type(s).

Sample output of ProducerPerformance is as follows:

10000000 records sent, 48107.452807 records/sec (9.18 MB/sec), 3284.34 ms avg latency, 3858.00 ms max latency, 3313 ms 50th, 3546 ms 95th, 3689 ms 99th, 3842 ms 99.9th.

It would be, however, nice to allow users to generate performance reports in a machine-readable format (such as CSV and JSON). This way, performance results could be easily processed by external applications (e.g. displayed in charts).

It will probably require a KIP.

Issue Links

• is related to: KAFKA-1939 Add csv reporter in ProducerPerformance for the new producer
• mentioned in: Page Loading...