[KAFKA-630] Auto create topic doesn't reflect the new topic and throws UnknownTopicOrPartitionException

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: 0.8.0
• Assignee: Unassigned
• Reporter: Neha Narkhede
• Created: 20/Nov/12 18:56
• Updated: 04/Dec/12 23:42
• Resolved: 04/Dec/12 23:42

Description

[2012-11-20 10:26:44,255] INFO [KafkaApi-1] Auto creation of topic t005 with 5 partitions and replication factor 1 is successful! (kafka.server.KafkaApis)

[2012-11-20 10:26:44,268] INFO [TopicChangeListener on Controller 1]: New topics: [Set(t005)], deleted topics: [Set()], new partition replica assignment [Map([t005,4] -> List(2), [t005,2] -> List(2), [t005,0] -> List(2), [t005,1] -> List(1), [t005,3] -> List(1))] (kafka.controller.PartitionStateMachine$TopicChangeListener)
[2012-11-20 10:26:44,268] INFO [Controller 1]: New topic creation callback for [t005,1],[t005,0],[t005,4],[t005,3],[t005,2] (kafka.controller.KafkaController)
[2012-11-20 10:26:44,270] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)
[2012-11-20 10:26:44,270] INFO [Controller 1]: New partition creation callback for [t005,1],[t005,0],[t005,4],[t005,3],[t005,2] (kafka.controller.KafkaController)
[2012-11-20 10:26:44,270] INFO [Partition state machine on Controller 1]: Invoking state change to NewPartition for partitions [t005,1],[t005,0],[t005,4],[t005,3],[t005,2] (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,273] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)
[2012-11-20 10:26:44,274] INFO [Partition state machine on Controller 1]: Partition [t005, 1] state changed from NotExists to New with assigned replicas 1 (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,276] INFO [Partition state machine on Controller 1]: Partition [t005, 0] state changed from NotExists to New with assigned replicas 2 (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,279] INFO [Partition state machine on Controller 1]: Partition [t005, 4] state changed from NotExists to New with assigned replicas 2 (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,283] INFO [Partition state machine on Controller 1]: Partition [t005, 3] state changed from NotExists to New with assigned replicas 1 (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,284] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)
[2012-11-20 10:26:44,286] INFO [Partition state machine on Controller 1]: Partition [t005, 2] state changed from NotExists to New with assigned replicas 2 (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,326] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)
[2012-11-20 10:26:44,326] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)
[2012-11-20 10:26:44,326] INFO [Replica state machine on Controller 1]: Invoking state change to NewReplica for replicas PartitionAndReplica(t005,0,2),PartitionAndReplica(t005,2,2),PartitionAndReplica(t005,1,1),PartitionAndReplica(t005,3,1),PartitionAndReplica(t005,4,2) (kafka.controller.ReplicaStateMachine)
[2012-11-20 10:26:44,327] INFO [Replica state machine on Controller 1]: Replica 2 for partition [t005, 0] state changed to NewReplica (kafka.controller.ReplicaStateMachine)
[2012-11-20 10:26:44,328] INFO [Replica state machine on Controller 1]: Replica 2 for partition [t005, 2] state changed to NewReplica (kafka.controller.ReplicaStateMachine)
[2012-11-20 10:26:44,328] INFO [Replica state machine on Controller 1]: Replica 1 for partition [t005, 1] state changed to NewReplica (kafka.controller.ReplicaStateMachine)
[2012-11-20 10:26:44,329] INFO [Replica state machine on Controller 1]: Replica 1 for partition [t005, 3] state changed to NewReplica (kafka.controller.ReplicaStateMachine)
[2012-11-20 10:26:44,330] INFO [Replica state machine on Controller 1]: Replica 2 for partition [t005, 4] state changed to NewReplica (kafka.controller.ReplicaStateMachine)
[2012-11-20 10:26:44,330] INFO [Partition state machine on Controller 1]: Invoking state change to OnlinePartition for partitions [t005,1],[t005,0],[t005,4],[t005,3],[t005,2] (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,394] INFO [Partition state machine on Controller 1]: Partition [t005, 1] state changed from OnlinePartition to OnlinePartition with leader 1 (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,418] INFO [Partition state machine on Controller 1]: Partition [t005, 0] state changed from OnlinePartition to OnlinePartition with leader 2 (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,442] INFO [Partition state machine on Controller 1]: Partition [t005, 4] state changed from OnlinePartition to OnlinePartition with leader 2 (kafka.controller.PartitionStateMachine)
[2012-11-20 10:26:44,451] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)
[2012-11-20 10:26:44,455] ERROR [KafkaApi-1] Error processing ProducerRequest on t005:1 (kafka.server.KafkaApis)
kafka.common.UnknownTopicOrPartitionException: Topic t005 partition 1 doesn't exist on 1
at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:163)
at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:244)
at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:239)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.map(Map.scala:93)
at kafka.server.KafkaApis.appendToLocalLog(KafkaApis.scala:239)
at kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:179)
at kafka.server.KafkaApis.handle(KafkaApis.scala:56)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
at java.lang.Thread.run(Thread.java:662)

Notice that topic t005 was successfully created, but still the produce request failed

Issue Links

• Is contained by: KAFKA-608 getTopicMetadata does not respect producer config settings