Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10888

Sticky partition leads to uneven product msg, resulting in abnormal delays in some partitions

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.4.1
    • Fix Version/s: None
    • Component/s: clients, producer
    • Labels:
      None

      Description

        110 producers ,550 partitions ,550 consumers , 5 nodes Kafka cluster
        The producer uses the nullkey+stick partitioner, the total production rate is about 100w tps
      Observed partition delay is abnormal and message distribution is uneven, which leads to the maximum production and consumption delay of the partition with more messages
      abnormal.

        I cannot find reason that stick will make the message distribution uneven at this production rate.
        I can't switch to the round-robin partitioner, which will increase the delay and cpu cost. Is thathe stick partationer design cause uneven message distribution, or this is abnormal. How to solve it?

       

      As shown in the picture, the uneven distribution is concentrated on some partitions and some brokers, there seems to be some rules.

      This problem does not only occur in one cluster, but in many high tps clusters,

      The problem is more obvious on the test cluster we built.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jr981008 jr
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated: