Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9173

StreamsPartitionAssignor assigns partitions to only one worker

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.3.0, 2.2.1
    • Fix Version/s: 2.6.0
    • Component/s: streams
    • Labels:

      Description

      I'm running a distributed KafkaStreams application on 10 worker nodes, subscribed to 21 topics with 10 partitions in each. I'm only using a Processor interface, and a persistent state store.

      However, only one worker gets assigned partitions, all other workers get nothing. Restarting the application, or cleaning local state stores does not help. StreamsPartitionAssignor migrates to other nodes, and eventually picks up other node to assign partitions to, but still only one node.

      It's difficult to figure out where to look for the signs of problems, I'm attaching the log messages from the StreamsPartitionAssignor. Let me know what else I could provide to help resolve this.

      StreamsPartitionAssignor.log

        Attachments

        1. StreamsPartitionAssignor.log
          58 kB
          Oleg Muravskiy

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              o.muravskiy Oleg Muravskiy
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: