[KAFKA-9482] mirror maker 2.0 doesn't replicates (create topic) created automatically by producing messages

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.4.0
• Component/s: mirrormaker
• Assignee: Unassigned
• Reporter: Mikhail Grinfeld
• Created: 30/Jan/20 06:43
• Updated: 08/Jul/20 07:58

Description

I have 2 kafka (3 brokers each) clusters and MirrorMaker instance.  (built with docker and docker-compose)

Both cluster is defined to create topics automatically (no auto.create.topics.enable in conf and default, at least as it appears in docs, is true).

If topic created on source cluster before MirrorMaker starts, everything works as expected: producig messages to source cluster, causes replication to destination cluster.

If topic doesn't exist on source cluster, when starting to produce messages, it created in source cluster, but not in destination - and no replication performed.

 

Using following mm2.properties:

# mm2.propertiesclusters=src,dest

src.bootstrap.servers=kafka-1:9092,kafka-2:19092,kafka-3:29092
dest.bootstrap.servers=kafka-4:39092,kafka-5:49092,kafka-6:59092

src->dest.enabled=true
src->dest.topics=.*

and running MirrorMaker with

connect-mirror-maker /etc/mm2.properties --clusters src dest

Note:

when I am using Kafka-Streams to read from initial topic, there are few KTable topics created automatically by Kafka-Stream - and these topics created OK (of course, when initial topic created at the beginning)