Objective - Use MM2 (kafka connect in distributed cluster) for data migration between cluster hosted in private data center and aws msk cluster.
Steps performed -
- Started kafka-connect service.
- Created 3 MM2 connectors (i.e. source connector, checkpoint connector and heartbeat connector). Curl commands used to create connectors are in the attached file. To exclude certain config properties while topic replication, we are using the 'config.properties.exclude' property in the MM2 source connector.
Source topic 'dev.portlandDc.anamika.helloMsk' should be successfully created in destination cluster.
Creation of the source topic 'dev.portlandDc.anamika.helloMsk' in destination cluster fails with an error. Error is