Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9678

Introduce bounded exponential backoff in clients

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: admin, consumer, producer
    • Labels:

      Description

      In all clients (consumer, producer, admin, and streams) we have retry mechanisms with fixed backoff to handle transient connection issues with brokers. However, with small backoff (many defaults to 100ms) we could send 10s of requests per second to the broker, and if the connection issue is prolonged it means a huge overhead.

      We should consider introducing upper-bounded exponential backoff universally in those clients to reduce the num of retry requests during the period of connection partitioning.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                skaundinya Sanjana Kaundinya
                Reporter:
                guozhang Guozhang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: