[AMBARI-10461] Spark History Server does not start with non-root agent

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.0.1
• Fix Version/s: 2.1.0
• Assignee: Andrew Onischuk
• Reporter: Andrew Onischuk
• Created: 14/Apr/15 08:00
• Updated: 21/May/15 14:29
• Resolved: 14/Apr/15 08:09

Description

When using a non-root agent, the Spark History Server fails to start even
though Ambari thinks the component Started. It appears that there is a failure
to create the: /etc/spark/conf/spark-defaults.conf file. No logs are produced
in /var/log/spark:

[ambari@revo5 spark]$ pwd
/var/log/spark
[ambari@revo5 spark]$ find .
.
[ambari@revo5 spark]$

This is with Ambari 2.0.0-148 with Stack: 2.2.3.0-2611.

There are no traces of spark-default.conf in /var/log/secure. So it seems like
it's trying to create the directory and file without using sudo, which in this
case will fail as Ambari Agent is running as a non-root 'ambari' user.

Issue Links

• links to: ReviewBoard