[AMBARI-21768] Spark History Server uses wrong log dir

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.5.2
• Fix Version/s: 2.5.2
• Component/s: ambari-server
• Assignee: Attila Doroszlai
• Reporter: Yesha Vora
• Created: 21/Aug/17 16:12
• Updated: 22/Aug/17 02:38
• Resolved: 22/Aug/17 02:38

Description

Steps to reproduce:

1. Install BI 4.2.0
2. Upgrade to Ambari 2.5.2
3. Upgrade to HDP 2.6
4. Run some Spark task (eg. spark-shell)
5. Open Spark History Server UI

Result: Spark History Server shows no jobs, because it reads logs from the wrong directory.

Note: Test with both default and customized spark.eventLog.dir configuration.

Issue Links

• links to: Review request