Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
2.4.0
-
None
-
None
Description
Hi,
i am trying to configure the the active/active with new kafka 2.4.0 and MM2.
I have 2 kafka clusters of 3 kafkas, one in lets say BO and on in IN.
In each cluster there are 3 kafkas.
Topics are replicated properly so in BO i see
topics
in.topics
in IN i see
topics
bo.topic
That should be according to documentation.
But when I stop the replication process on one data center and start it up, the replication replicate the topics with the same prefix twice bo.bo.topics or in.in.topics depending on what connector i restart.
I have also blacklisted the topics but they are still replicating.
bo.properties file
name = in-bo
#topics = .*
topics.blacklist = "bo.*"
#groups = .*
connector.class = org.apache.kafka.connect.mirror.MirrorSourceConnector
tasks.max = 10source.cluster.alias = in
target.cluster.alias = bo
source.cluster.bootstrap.servers = IN-kafka1:9092,IN-kafka2:9092,IN-kafka3:9092
target.cluster.bootstrap.servers = BO-kafka1:9092,BO-kafka2:9092,bo-kafka39092use ByteArrayConverter to ensure that records are not re-encoded
key.converter = org.apache.kafka.connect.converters.ByteArrayConverter
value.converter = org.apache.kafka.connect.converters.ByteArrayConverter
in.properties
name = bo-in
#topics = .*
topics.blacklist = "in.*"
#groups = .*
connector.class = org.apache.kafka.connect.mirror.MirrorSourceConnector
tasks.max = 10source.cluster.alias = bo
target.cluster.alias = in
target.cluster.bootstrap.servers = IN-kafka1:9092,IN-kafka2:9092,IN-kafka3:9092
source.cluster.bootstrap.servers = BO-kafka1:9092,BO-kafka2:9092,BO-kafka3:9092use ByteArrayConverter to ensure that records are not re-encoded
key.converter = org.apache.kafka.connect.converters.ByteArrayConverter
value.converter = org.apache.kafka.connect.converters.ByteArrayConverter