[KAFKA-10128] MM2 - Delete topics when config sync is enabled

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.5.0
• Component/s: connect, mirrormaker
• Assignee: Unassigned
• Reporter: Karthik
• Reviewer: Ryanne Dolan
• Created: 09/Jun/20 10:58
• Updated: 09/Jun/20 11:37

Description

Topics being deleted on one region is not being deleted and with that its being recreated incase of a active-active deployment

 

Logs:

Test Check delete Topic

 

Delete Command

/opt/kafka/bin/kafka-topics.sh --bootstrap-server 192.168.0.32:9092 --delete --topic im115

 

Source cluster - Before

/opt/kafka/bin/kafka-topics.sh --bootstrap-server 192.168.0.32:9092 --list

__consumer_offsets

heartbeats

im115

im32

mm2-configs.us-east.internal

mm2-offset-syncs.us-east.internal

mm2-offsets.us-east.internal

mm2-status.us-east.internal

us-east.checkpoints.internal

us-east.heartbeats

us-east.im115

us-east.us-east-offsets

us-west-offsets

 

Source cluster - After delete

/opt/kafka/bin/kafka-topics.sh --bootstrap-server 192.168.0.32:9092 --list

__consumer_offsets

heartbeats

im32

mm2-configs.us-east.internal

mm2-offset-syncs.us-east.internal

mm2-offsets.us-east.internal

mm2-status.us-east.internal

us-east.checkpoints.internal

us-east.heartbeats

us-east.im115

us-east.us-east-offsets

us-west-offsets

 

Dest Cluster - Before

/opt/kafka/bin/kafka-topics.sh --bootstrap-server 192.168.3.115:9092 --list             __consumer_offsets

heartbeats

im115

mm2-configs.us-west.internal

mm2-offset-syncs.us-west.internal

mm2-offsets.us-west.internal

mm2-status.us-west.internal

us-east-offsets

us-west.checkpoints.internal

us-west.heartbeats

us-west.im115

us-west.im32

us-west.us-west-offsets

 ** 

Dest Cluster - After Delete

Did not delete

/opt/kafka/bin/kafka-topics.sh --bootstrap-server 192.168.3.115:9092 --list __consumer_offsets
heartbeats
im115
mm2-configs.us-west.internal
mm2-offset-syncs.us-west.internal
mm2-offsets.us-west.internal
mm2-status.us-west.internal
us-east-offsets
us-west.checkpoints.internal
us-west.heartbeats
us-west.im115
us-west.im32
us-west.us-west-offsets

 

With that after the config refresh mins, the deleted topic is being replicated back on the source cluster

/opt/kafka/bin/kafka-topics.sh --bootstrap-server 192.168.0.32:9092 --list
__consumer_offsets
heartbeats
im115
im32
mm2-configs.us-east.internal
mm2-offset-syncs.us-east.internal
mm2-offsets.us-east.internal
mm2-status.us-east.internal
us-east.checkpoints.internal
us-east.heartbeats
us-east.im115
us-east.us-east-offsets
us-west-offsets

Issue Links

• is part of: KAFKA-7500 MirrorMaker 2.0 (KIP-382)