[AMBARI-15627] Ambari is expecting hadoop client package and configuration, even if no HDFS components are installed on this host

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.2.2
• Fix Version/s: 2.2.2
• Component/s: ambari-server
• Assignee: Dmytro Grinenko
• Reporter: Dmytro Grinenko
• Created: 30/Mar/16 12:06
• Updated: 12/Jun/17 20:38
• Resolved: 30/Mar/16 16:36

Description

This happens during an ugprade from HDP 2.3.0 to 2.3.4.7. Couple nodes have Kafka broker/Zookeeper installed with no clients or any other components. Hence, during the installation, there is no HDFS package installed on this node. However, during the start up Ambari expects this node to have /usr/hdp/current/hadoop-client/conf' during the start up:

Traceback (most recent call last): 
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 39, in <module> 
BeforeStartHook().execute() 
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute 
method(env) 
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 36, in hook 
create_topology_script_and_mapping() 
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/rack_awareness.py", line 69, in create_topology_script_and_mapping 
create_topology_mapping() 
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/rack_awareness.py", line 36, in create_topology_mapping 
group=params.user_group) 
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__ 
self.env.run() 
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run 
self.run_action(resource, action) 
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 121, in run_action 
provider_action() 
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 152, in action_create 
sudo.makedirs(path, self.resource.mode or 0755) 
File "/usr/lib/python2.6/site-packages/resource_management/core/sudo.py", line 55, in makedirs 
os.makedirs(path, mode) 
File "/usr/lib64/python2.6/os.py", line 157, in makedirs 
mkdir(name, mode) 
OSError: [Errno 2] No such file or directory: '/usr/hdp/current/hadoop-client/conf' 
Error: Error: Unable to run the custom hook script ['/usr/bin/python2', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py', 'START', '/var/lib/ambari-agent/data/command-3343.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START', '/var/lib/ambari-agent/data/structured-out-3343.json', 'INFO', '/var/lib/ambari-agent/tmp']

Issue Links

• links to: Review Board