Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5795 Make the idempotent producer the default producer setting
  3. KAFKA-5796

Understand performance implications of acks=all and potential ways to reduce it

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      To get exactly once semantics, we need acks=all. However, we know that there is a latency and throughput impact with acks=all when compared with acks=1.

      The impact is quantified here:
      https://cwiki.apache.org/confluence/display/KAFKA/An+analysis+of+the+impact+of+max.in.flight.requests.per.connection+and+acks+on+Producer+performance

      However, we can't explain some of that data. Nor do we know the causes for some of the degradation. We would like to understand the performance of acks=all at the very minimum before making it the default producer setting.

      Attachments

        Activity

          People

            apurva Apurva Mehta
            apurva Apurva Mehta
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: