[AMBARI-21576] Livy2 server startup failure if no webhdfs enabled

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0, 2.5.1
• Fix Version/s: 3.0.0, 2.5.2
• Assignee: Unassigned
• Reporter: Ferenc Schneider
• Created: 26/Jul/17 15:52
• Updated: 26/Jul/17 17:41
• Resolved: 26/Jul/17 17:01

Description

Livy2 server startup failure if no webhdfs enabled. The problem happened when creating a cluster using Cloudbreak on Azure with default WASB filesystem.

The following exception is thrown:

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/SPARK2/2.0.0/package/scripts/livy2_server.py", line 148, in <module>
    LivyServer().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 314, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/SPARK2/2.0.0/package/scripts/livy2_server.py", line 59, in start
    self.wait_for_dfs_directories_created([params.entity_groupfs_store_dir, params.entity_groupfs_active_dir])
  File "/var/lib/ambari-agent/cache/common-services/SPARK2/2.0.0/package/scripts/livy2_server.py", line 91, in wait_for_dfs_directories_created
    self.wait_for_dfs_directory_created(dir_path, ignored_dfs_dirs)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py", line 48, in wrapper
    return function(*args, **kwargs)
  File "/var/lib/ambari-agent/cache/common-services/SPARK2/2.0.0/package/scripts/livy2_server.py", line 120, in wait_for_dfs_directory_created
    dfs_ret_code = shell.call(format("hdfs --config {hadoop_conf_dir} dfs -test -d " + dir_path), user=params.livy_user)[0]
AttributeError: 'module' object has no attribute 'livy_user'