[KAFKA-3114] can't create as many partitions as brokers exists

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.8.2.2, 0.9.0.0
• Environment: 3 server with ubuntu 15.04; zookeeper 3.4.6
• Assignee: Unassigned
• Reporter: Lukas Schmitt
• Created: 17/Jan/16 14:57
• Updated: 29/Jun/17 10:16
• Resolved: 18/Jan/16 17:57

Description

i have three kafka-brokers running (57, 58, 59)

when i try to create a topic with 3 partition and a replication factor higher than 1, i get the following error in the broker logs over and over again until i delete the topic:

ERROR [ReplicaFetcherThread-0-58], Error for partition [reptest,0] to broker 58:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)

i use the following command to create the topic:

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 3 --partitions 3 --topic reptest

when i execute the command on a follower broker, the leader spams the following:

WARN [Replica Manager on Broker 57]: While recording the replica LEO, the partition [reptest,0] hasn't been created. (kafka.server.ReplicaManager)

each broker has the same configuration except the broker.id and the advertised.host.name

broker.id=<ID>
port=9092
advertised.host.name=<ADVERTISED_HOST_IP_ADDRESS>
num.network.threads=3
num.io.threads=8
log.dirs=/tmp/kafka
num.partitions=1
num.recovery.threads.per.data.dir=1
log.cleaner.enable=true

log.cleanup.policy=compact

zookeeper.connect=localhost:2181
zookeeper.connection.timeout.ms=10000
delete.topic.enable=true

as long as the amount of partitions is smaller than the number of brokers i can create topics without this error.
shouldn't it be possible to sync a topic over all brokers?