Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9173

StreamsPartitionAssignor assigns partitions to only one worker

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.3.0, 2.2.1
    • 2.6.0
    • streams

    Description

      I'm running a distributed KafkaStreams application on 10 worker nodes, subscribed to 21 topics with 10 partitions in each. I'm only using a Processor interface, and a persistent state store.

      However, only one worker gets assigned partitions, all other workers get nothing. Restarting the application, or cleaning local state stores does not help. StreamsPartitionAssignor migrates to other nodes, and eventually picks up other node to assign partitions to, but still only one node.

      It's difficult to figure out where to look for the signs of problems, I'm attaching the log messages from the StreamsPartitionAssignor. Let me know what else I could provide to help resolve this.

      StreamsPartitionAssignor.log

      Attachments

        1. StreamsPartitionAssignor.log
          58 kB
          Oleg Muravskiy

        Activity

          People

            Unassigned Unassigned
            o.muravskiy Oleg Muravskiy
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: