Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3114

can't create as many partitions as brokers exists

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 0.8.2.2, 0.9.0.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:
      3 server with ubuntu 15.04
      zookeeper 3.4.6

      Description

      i have three kafka-brokers running (57, 58, 59)

      when i try to create a topic with 3 partition and a replication factor higher than 1, i get the following error in the broker logs over and over again until i delete the topic:

      ERROR [ReplicaFetcherThread-0-58], Error for partition [reptest,0] to broker 58:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
      

      i use the following command to create the topic:

      bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 3 --partitions 3 --topic reptest
      

      when i execute the command on a follower broker, the leader spams the following:

      WARN [Replica Manager on Broker 57]: While recording the replica LEO, the partition [reptest,0] hasn't been created. (kafka.server.ReplicaManager)
      

      each broker has the same configuration except the broker.id and the advertised.host.name

      broker.id=<ID>
      port=9092
      advertised.host.name=<ADVERTISED_HOST_IP_ADDRESS>
      num.network.threads=3
      num.io.threads=8
      log.dirs=/tmp/kafka
      num.partitions=1
      num.recovery.threads.per.data.dir=1
      log.cleaner.enable=true
      
      log.cleanup.policy=compact
      
      zookeeper.connect=localhost:2181
      zookeeper.connection.timeout.ms=10000
      delete.topic.enable=true
      

      as long as the amount of partitions is smaller than the number of brokers i can create topics without this error.
      shouldn't it be possible to sync a topic over all brokers?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ljmsc Lukas Schmitt
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: