[KAFKA-16180] Full metadata request sometimes fails during zk migration

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.7.0
• Fix Version/s: 3.7.0, 3.6.2
• Assignee: Unassigned
• Reporter: Colin McCabe
• Created: 20/Jan/24 00:37
• Updated: 14/Mar/24 14:55
• Resolved: 14/Mar/24 14:55

Description

Example:

java.util.NoSuchElementException: topic_name
        at scala.collection.mutable.AnyRefMap$ExceptionDefault.apply(AnyRefMap.scala:508)
        at scala.collection.mutable.AnyRefMap$ExceptionDefault.apply(AnyRefMap.scala:507)
        at scala.collection.mutable.AnyRefMap.apply(AnyRefMap.scala:207)
        at kafka.server.metadata.ZkMetadataCache$.$anonfun$maybeInjectDeletedPartitionsFromFullMetadataRequest$2(ZkMetadataCache.scala:112)
        at kafka.server.metadata.ZkMetadataCache$.$anonfun$maybeInjectDeletedPartitionsFromFullMetadataRequest$2$adapted(ZkMetadataCache.scala:105)
        at scala.collection.immutable.HashSet.foreach(HashSet.scala:958)
        at kafka.server.metadata.ZkMetadataCache$.maybeInjectDeletedPartitionsFromFullMetadataRequest(ZkMetadataCache.scala:105)
        at kafka.server.metadata.ZkMetadataCache.$anonfun$updateMetadata$1(ZkMetadataCache.scala:506)
        at kafka.utils.CoreUtils$.inWriteLock(CoreUtils.scala:183)
        at kafka.server.metadata.ZkMetadataCache.updateMetadata(ZkMetadataCache.scala:496)
        at kafka.server.ReplicaManager.maybeUpdateMetadataCache(ReplicaManager.scala:2482)
        at kafka.server.KafkaApis.handleUpdateMetadataRequest(KafkaApis.scala:733)
        at kafka.server.KafkaApis.handle(KafkaApis.scala:349)
        at kafka.server.KafkaRequestHandler.$anonfun$poll$8(KafkaRequestHandler.scala:210)
        at kafka.server.KafkaRequestHandler.$anonfun$poll$8$adapted(KafkaRequestHandler.scala:210)
        at io.confluent.kafka.availability.ThreadCountersManager.wrapEngine(ThreadCountersManager.java:146)
        at kafka.server.KafkaRequestHandler.poll(KafkaRequestHandler.scala:210)
        at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:151)
        at java.base/java.lang.Thread.run(Thread.java:1583)
        at org.apache.kafka.common.utils.KafkaThread.run(KafkaThread.java:66)

Issue Links

• links to: GitHub Pull Request #15293