Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
2.5.1
-
None
-
RHEL 7 Linux.
Description
We are using Mirror Maker 2 from the 2.5.1 release for replication on some clusters. Replication is working as expected for existing topics. When we create a new topic, however, Mirror Maker 2 creates the replicated topic as expected but never starts replicating it. If we restart Mirror Maker 2 within 2-3 minutes the topic starts replicating as expected. From documentation we haveve seen it appears this should start replicating without a restart based on the settings we have.
Example:
Create topic "mytesttopic" on source cluster
MirrorMaker 2 creates "source.mytesttopioc" on target cluster with no issue
MirrorMaker 2 does not replicate "mytesttopic" -> "source.mytesttopic"
Restart MirrorMaker 2 and now replication works for "mytesttopic" -> "source.mytesttopic"
Example config:
name = source->target
group.id = source-to-target
clusters = source, target
source.bootstrap.servers = sourcehosts:9092
target.bootstrap.servers = targethosts:9092
source->target.enabled = true
source->target.topics = .*
target->source = false
target->source.topics = .*
replication.factor=3
checkpoints.topic.replication.factor=3
heartbeats.topic.replication.factor=3
offset-syncs.topic.replication.factor=3
offset.storage.replication.factor=3
status.storage.replication.factor=3
config.storage.replication.factor=3
tasks.max = 16
refresh.topics.enabled = true
sync.topic.configs.enabled = true
refresh.topics.interval.seconds = 300
refresh.groups.interval.seconds = 300
readahead.queue.capacity = 100
emit.checkpoints.enabled = true
emit.checkpoints.interval.seconds = 5
Attachments
Issue Links
- is fixed by
-
KAFKA-10586 Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
-
- Resolved
-