[AMBARI-17294] Retry logic for creating /ambari-solr znode for logsearch Solr

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.0
• Component/s: ambari-logsearch, ambari-server
• Assignee: Oliver Szabo
• Reporter: Oliver Szabo
• Created: 17/Jun/16 13:10
• Updated: 21/Jun/16 16:18
• Resolved: 21/Jun/16 16:18

Description

Cluster deployed with blueprint. Log Search Server start failed due to error:

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/LOGSEARCH/0.5.0/package/scripts/logsearch.py", line 64, in <module>
    LogSearch().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 257, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/LOGSEARCH/0.5.0/package/scripts/logsearch.py", line 43, in start
    self.configure(env)
  File "/var/lib/ambari-agent/cache/common-services/LOGSEARCH/0.5.0/package/scripts/logsearch.py", line 38, in configure
    setup_logsearch()
  File "/var/lib/ambari-agent/cache/common-services/LOGSEARCH/0.5.0/package/scripts/setup_logsearch.py", line 92, in setup_logsearch
    upload_conf_set(format('{logsearch_solr_collection_service_logs}'), random_num)
  File "/var/lib/ambari-agent/cache/common-services/LOGSEARCH/0.5.0/package/scripts/setup_logsearch.py", line 114, in upload_conf_set
    user=params.logsearch_solr_user)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/solr_cloud_util.py", line 49, in upload_configuration_to_zk
    user=user
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, in _call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'export JAVA_HOME=/usr/jdk64/jdk1.7.0_67 ; /usr/lib/ambari-logsearch-solr-client/solrCloudCli.sh -z nat-os-r7-uepcxu-stackdeploy-1.openstacklocal:2181,nat-os-r7-uepcxu-stackdeploy-2.openstacklocal:2181,nat-os-r7-uepcxu-stackdeploy-4.openstacklocal:2181,nat-os-r7-uepcxu-stackdeploy-5.openstacklocal:2181/ambari-solr --upload-config -d /etc/ambari-logsearch-portal/conf/solr_configsets/hadoop_logs/conf -cs hadoop_logs -rt 5 -i 10' returned 1. Using default ZkCredentialsProvider

This error occurs during Logsearch portal start, reason is znode was not created during solr bootsrapping

Issue Links

• links to: Review Board