[KAFKA-15799] ZK brokers incorrectly handle KRaft metadata snapshots

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.7.0, 3.6.1
• Assignee: David Arthur
• Reporter: David Arthur
• Created: 08/Nov/23 17:19
• Updated: 17/Nov/23 13:22
• Resolved: 17/Nov/23 13:21

Description

While working on the fix for KAFKA-15605, I noticed that ZK brokers are unconditionally merging data from UpdateMetadataRequest with their existing MetadataCache. This is not the correct behavior when handling a metadata snapshot from the KRaft controller.

For example, if a topic was deleted in KRaft and not transmitted as part of a delta update (e.g., during a failover) then the ZK brokers will never remove the topic from their cache (until they restart and rebuild their cache).

Issue Links

• links to: GitHub Pull Request #14719