Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
-
None
Description
I'm running 2 clusters: K9 with Kafka 0.9 and K10 with Kafka 0.10.1.
In K10, I've set up mirror maker to clone a topic from K9 to K10.
Mirror maker immediately fails while starting, any suggestion? Following error message and configs.
Error message:
[2016-10-26 23:54:01,663] FATAL [mirrormaker-thread-0] Mirror maker thread failure due to (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.protocol.types.SchemaException: Error reading field 'cluster_id': Error reading string of length 418, only 43 bytes available
at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
at org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:380)
at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:449)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:232)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:180)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:193)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:248)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979)
at kafka.tools.MirrorMaker$MirrorMakerNewConsumer.receive(MirrorMaker.scala:582)
at kafka.tools.MirrorMaker$MirrorMakerThread.run(MirrorMaker.scala:431)
[2016-10-26 23:54:01,679] FATAL [mirrormaker-thread-0] Mirror maker thread exited abnormally, stopping the whole mirror maker. (kafka.tools.MirrorMaker$MirrorMakerThread)
Consumer:
group.id=mirrormaker001 client.id=mirrormaker001 bootstrap.servers=...K9... security.protocol=PLAINTEXT auto.offset.reset=earliest
(note that I first run without client.id, then tried adding a client.id because – same error in both cases)
Producer:
bootstrap.servers=...K10... security.protocol=PLAINTEXT