Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1563

High packet rate between brokers in kafka cluster.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • 0.8.1.1
    • None
    • None
    • None

    Description

      On our kafka cluster with 3 brokers and input 40MB/s we see about 100K packets/s traffic between brokers(not including consumers). Majority of packets have small size(about 20bytes of data).

      I have found that kafka server sets TcpNoDelay option on all sockets. https://github.com/apache/kafka/blob/0.8.1/core/src/main/scala/kafka/network/SocketServer.scala#L202
      And I think that causes the issue.

      Can you please explain current behavior and fix it/make it configurable?

      Attachments

        Activity

          People

            Unassigned Unassigned
            slon Fedor Korotkiy
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: