[AMBARI-10056] Kafka service check fails after adding Kafka via Add Services

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: ambari-server
• Assignee: Harsha
• Reporter: Siddharth Wagle
• Created: 13/Mar/15 03:27
• Updated: 13/Mar/15 06:20
• Resolved: 13/Mar/15 03:59

Description

STR

1. Deploy ambari
2. Add Kafka via Add Services

AR. Kafka Service check fails

2015-03-10 15:31:24,760 - Error while executing command 'service_check':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/KAFKA/0.8.1.2.2/package/scripts/service_check.py", line 42, in service_check
    call_and_match_output(command, format("({create_topic_cmd_created_output})|({create_topic_cmd_exists_output})"), "Failed to check that topic exists")
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py", line 54, in wrapper
    return function(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/validate.py", line 36, in call_and_match_output
    raise Fail(err_message)
Fail: Failed to check that topic exists

stdout:   /var/lib/ambari-agent/data/output-178.txt

2015-03-10 15:30:51,384 - Running kafka create topic command: source /etc/kafka/conf/kafka-env.sh ; /usr/hdp/current/kafka-broker//bin/kafka-topics.sh --zookeeper c6401.ambari.apache.org:2181,c6402.ambari.apache.org:2181 --create --topic ambari_kafka_service_check --partitions 1 --replication-factor 1
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:30:53,052 - Will retry 9 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:30:56,581 - Will retry 8 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:31:00,120 - Will retry 7 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:31:03,504 - Will retry 6 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:31:06,948 - Will retry 5 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:31:10,383 - Will retry 4 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:31:13,883 - Will retry 3 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:31:17,361 - Will retry 2 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:31:21,362 - Will retry 1 time(s), caught exception: Failed to check that topic exists. Sleeping for 2 sec(s)
Error while executing topic command replication factor: 1 larger than available brokers: 0
kafka.admin.AdminOperationException: replication factor: 1 larger than available brokers: 0
	at kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:155)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:86)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:50)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)

2015-03-10 15:31:24,760 - Error while executing command 'service_check':
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/KAFKA/0.8.1.2.2/package/scripts/service_check.py", line 42, in service_check
    call_and_match_output(command, format("({create_topic_cmd_created_output})|({create_topic_cmd_exists_output})"), "Failed to check that topic exists")
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py", line 54, in wrapper
    return function(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/validate.py", line 36, in call_and_match_output
    raise Fail(err_message)
Fail: Failed to check that topic exists