[KAFKA-7667] Need synchronous records send support for kafka performance producer java application.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0
• Component/s: tools
• Assignee: kaushik srinivas
• Reporter: kaushik srinivas
• Created: 22/Nov/18 09:40
• Updated: 22/Nov/18 09:46

Description

Why synchronous send support for performance producer ?

ProducerPerformance java application is used for load testing kafka brokers.
Load testing involves replicating very high throughput records flowing in to kafka brokers and
many producers in field would use synchronous way of sending data i.e blocking until the message has been
written completely on all the min.insyc.replicas no of brokers.

Asynchronous sends would satisfy the first requirement of loading kafka brokers.

This requirement would help in performance tuning the kafka brokers when producers are deployed with "acks": all, "min.insync.replicas" :
equal to replication factor and synchronous way of sending.
Throughput degradation happens with synchronous producers and this would help in
tuning resources for replication in kafka brokers.
Also benchmarks could be made from kafka producer perspective with synchronous way of sending records and tune kafka producer's
resources appropriately.

Issue Links

• links to: GitHub Pull Request #5939