Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
2.6.0
-
None
-
None
Description
We need to setup mirror maker from a single node kafka cluster to a three node Strimzi cluster. There is no SSL setup at source, however the target cluster is configured with MTLS.
With below config, commands from source like listing topics etc are working:
cat client-ssl.properties security.protocol=SSL ssl.truststore.location=my.truststore ssl.truststore.password=123456 ssl.keystore.location=my.keystore ssl.keystore.password=123456 ssl.key.password=password
However, we are not able to get mirror maker working with the similar configs:
source.security.protocol=PLAINTEXT target.security.protocol=SSL target.ssl.truststore.location=my.truststore target.ssl.truststore.password=123456 target.ssl.keystore.location=my.keystore target.ssl.keystore.password=123456 target.ssl.key.password=password
Errors while running mirror maker:
org.apache.kafka.common.errors.TimeoutException: Call(callName=fetchMetadata, deadlineMs=1605011994642, tries=1, nextAllowedTryMs=1605011994743) timed out at 1605011994643 after 1 attempt(s) Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: fetchMetadata [2020-11-10 12:40:24,642] INFO App info kafka.admin.client for adminclient-8 unregistered (org.apache.kafka.common.utils.AppInfoParser:83) [2020-11-10 12:40:24,643] INFO [AdminClient clientId=adminclient-8] Metadata update failed (org.apache.kafka.clients.admin.internals.AdminMetadataManager:235) org.apache.kafka.common.errors.TimeoutException: Call(callName=fetchMetadata, deadlineMs=1605012024643, tries=1, nextAllowedTryMs=-9223372036854775709) timed out at 9223372036854775807 after 1attempt(s) Caused by: org.apache.kafka.common.errors.TimeoutException: The AdminClient thread has exited. Call: fetchMetadata [2020-11-10 12:40:24,644] INFO Metrics scheduler closed (org.apache.kafka.common.metrics.Metrics:668) [2020-11-10 12:40:24,644] INFO Closing reporter org.apache.kafka.common.metrics.JmxReporter (org.apache.kafka.common.metrics.Metrics:672) [2020-11-10 12:40:24,644] INFO Metrics reporters closed (org.apache.kafka.common.metrics.Metrics:678) [2020-11-10 12:40:24,645] ERROR Stopping due to error (org.apache.kafka.connect.mirror.MirrorMaker:304) org.apache.kafka.connect.errors.ConnectException: Failed to connect to and describe Kafka cluster. Check worker's broker connection and security properties. at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:70) at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:51) at org.apache.kafka.connect.mirror.MirrorMaker.addHerder(MirrorMaker.java:235) at org.apache.kafka.connect.mirror.MirrorMaker.lambda$new$1(MirrorMaker.java:136) at java.lang.Iterable.forEach(Iterable.java:75) at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:136) at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:148) at org.apache.kafka.connect.mirror.MirrorMaker.main(MirrorMaker.java:291) Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1605012024641, tries=1, nextAllowedTryMs=1605012024742)timed out at 1605012024642 after 1 attempt(s) at org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45) at org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32) at org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89) at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260) at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:64) ... 7 more Caused by: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1605012024641, tries=1, nextAllowedTryMs=1605012024742) timed out at 1605012024642 after 1 attempt(s) Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listNodes