Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9215

Mirrormaker 2.0 (connect-standalone.sh)

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Open
    • Trivial
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      I'm testing to replicate all topics from one Kafka cluster to replica Kafka cluster(active/pasive), with the same topic name, include topic data, consumers' offset and configuration settings for topics. I can see topic data and consumers' offset, but I am not able to see the configuration settings for topic. I also need to have the same name for topic in replica. Can anyone explain what I am doing wrong?

       

      Setup for my test is:

      ../bin/connect-standalone.sh worker.properties connect-mirror-source.properties > worker-connect.log

       

      worker.properties:

      bootstrap.servers=host:port
      key.converter=org.apache.kafka.connect.converters.ByteArrayConverter
      value.converter=org.apache.kafka.connect.converters.ByteArrayConverter
      offset.storage.file.filename=/tmp/connect.offsets

      connect-mirror-source.properties:

      name = local-mirror-source
      connector.class = org.apache.kafka.connect.mirror.MirrorSourceConnector
      topics = test-event
      topics.blacklist = [".*\.internal", ".*\.replica", "__consumer_offsets"]
      source.cluster.alias = upstream
      target.cluster.alias =
      source.cluster.bootstrap.servers = host:port
      target.cluster.bootstrap.servers =  host:port
      sync.topic.acls = false
      rename.topics = true
      tasks.max = 1
      key.converter=org.apache.kafka.connect.converters.ByteArrayConverter
      value.converter=org.apache.kafka.connect.converters.ByteArrayConverter

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            JAS71 Jan Arve Sundt
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: