[KAFKA-7065] Quickstart tutorial fails because of missing brokers

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 1.1.0
• Component/s: website
• Environment: Java 1.8.0_162 ; MacOS 10.13.4
• Assignee: Unassigned
• Reporter: Holger Brandl
• Created: 16/Jun/18 08:51
• Updated: 18/Jun/18 07:31
• Resolved: 18/Jun/18 07:31

Description

Following the tutorial on https://kafka.apache.org/quickstart I've tried setup a kafka instance with

wget --no-check-certificate http://apache.lauf-forum.at/kafka/1.1.0/kafka_2.12-1.1.0.tgz

tar xvf kafka_2.12-1.1.0.tgz

## start the server
cd kafka_2.12-1.1.0
bin/zookeeper-server-start.sh config/zookeeper.properties

 

Until here everything is fine, and it is reporting:

 

[kafka_2.12-1.1.0]$ bin/zookeeper-server-start.sh config/zookeeper.properties[2018-06-16 10:38:41,238] INFO Reading configuration from: config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)[2018-06-16 10:38:41,240] INFO autopurge.snapRetainCount set to 3 (org.apache.zookeeper.server.DatadirCleanupManager)[2018-06-16 10:38:41,241] INFO autopurge.purgeInterval set to 0 (org.apache.zookeeper.server.DatadirCleanupManager)[2018-06-16 10:38:41,241] INFO Purge task is not scheduled. (org.apache.zookeeper.server.DatadirCleanupManager)[2018-06-16 10:38:41,241] WARN Either no config or no quorum defined in config, running  in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)[2018-06-16 10:38:41,272] INFO Reading configuration from: config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)[2018-06-16 10:38:41,273] INFO Starting server (org.apache.zookeeper.server.ZooKeeperServerMain)[2018-06-16 10:38:41,299] INFO Server environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,300] INFO Server environment:host.name=192.168.0.8 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,300] INFO Server environment:java.version=1.8.0_162 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,300] INFO Server environment:java.vendor=Oracle Corporation (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,300] INFO Server environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_162.jdk/Contents/Home/jre (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,300] INFO Server environment:java.class.path=/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/aopalliance-repackaged-2.5.0-b32.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/argparse4j-0.7.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/commons-lang3-3.5.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/connect-api-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/connect-file-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/connect-json-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/connect-runtime-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/connect-transforms-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/guava-20.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/hk2-api-2.5.0-b32.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/hk2-locator-2.5.0-b32.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/hk2-utils-2.5.0-b32.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jackson-annotations-2.9.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jackson-core-2.9.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jackson-databind-2.9.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jackson-jaxrs-base-2.9.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jackson-jaxrs-json-provider-2.9.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jackson-module-jaxb-annotations-2.9.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/javassist-3.20.0-GA.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/javassist-3.21.0-GA.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/javax.annotation-api-1.2.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/javax.inject-1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/javax.inject-2.5.0-b32.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/javax.servlet-api-3.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/javax.ws.rs-api-2.0.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jersey-client-2.25.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jersey-common-2.25.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jersey-container-servlet-2.25.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jersey-container-servlet-core-2.25.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jersey-guava-2.25.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jersey-media-jaxb-2.25.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jersey-server-2.25.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-client-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-continuation-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-http-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-io-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-security-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-server-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-servlet-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-servlets-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jetty-util-9.2.24.v20180105.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/jopt-simple-5.0.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka-clients-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka-log4j-appender-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka-streams-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka-streams-examples-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka-streams-test-utils-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka-tools-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka_2.12-1.1.0-sources.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka_2.12-1.1.0-test-sources.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/kafka_2.12-1.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/log4j-1.2.17.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/lz4-java-1.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/maven-artifact-3.5.2.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/metrics-core-2.2.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/osgi-resource-locator-1.0.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/plexus-utils-3.1.0.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/reflections-0.9.11.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/rocksdbjni-5.7.3.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/scala-library-2.12.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/scala-logging_2.12-3.7.2.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/scala-reflect-2.12.4.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/slf4j-api-1.7.25.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/slf4j-log4j12-1.7.25.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/snappy-java-1.1.7.1.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/validation-api-1.1.0.Final.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/zkclient-0.10.jar:/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0/bin/../libs/zookeeper-3.4.10.jar (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,301] INFO Server environment:java.library.path=/Users/brandl/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,301] INFO Server environment:java.io.tmpdir=/var/folders/cl/j57y4y2504n1nnlyd4q41fj40000gp/T/ (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,302] INFO Server environment:java.compiler=<NA> (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,302] INFO Server environment:os.name=Mac OS X (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,302] INFO Server environment:os.arch=x86_64 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,302] INFO Server environment:os.version=10.13.4 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,302] INFO Server environment:user.name=brandl (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,302] INFO Server environment:user.home=/Users/brandl (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,302] INFO Server environment:user.dir=/Users/brandl/projects/kotlin/kafka/kafka_2.12-1.1.0 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,311] INFO tickTime set to 3000 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,311] INFO minSessionTimeout set to -1 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,311] INFO maxSessionTimeout set to -1 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:38:41,335] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)

 

However when creating a topic as suggested in the tutorial with

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic 

it fails with

[kafka_2.12-1.1.0]$ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test[2018-06-16 10:39:19,968] INFO Accepted socket connection from /127.0.0.1:49734 (org.apache.zookeeper.server.NIOServerCnxnFactory)[2018-06-16 10:39:19,976] INFO Client attempting to establish new session at /127.0.0.1:49734 (org.apache.zookeeper.server.ZooKeeperServer)[2018-06-16 10:39:19,979] INFO Creating new log file: log.d (org.apache.zookeeper.server.persistence.FileTxnLog)[2018-06-16 10:39:19,985] INFO Established session 0x16407bf17d40000 with negotiated timeout 30000 for client /127.0.0.1:49734 (org.apache.zookeeper.server.ZooKeeperServer)Error while executing topic command : Replication factor: 1 larger than available brokers: 0.[2018-06-16 10:39:20,047] ERROR org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 1 larger than available brokers: 0.{{ (kafka.admin.TopicCommand$)}}[2018-06-16 10:39:20,049] INFO Processed session termination for sessionid: 0x16407bf17d40000 (org.apache.zookeeper.server.PrepRequestProcessor)[2018-06-16 10:39:20,051] INFO Closed socket connection for client /127.0.0.1:49734 which had sessionid 0x16407bf17d40000 (org.apache.zookeeper.server.NIOServerCnxn)

 

It seems that the quickstart configuration fails to instantiate any brokers.