[SPARK-11074] Attempt to automatically create event log directory if it doesn't already exist

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 1.5.1
• Component/s: Spark Core
• Target Version/s: 1.6.0
• Assignee: Kay Ousterhout
• Reporter: Kay Ousterhout
• Created: 12/Oct/15 23:35
• Updated: 13/Oct/15 03:55
• Resolved: 13/Oct/15 03:55

Description

Right now, if the log where event logs are to be placed (spark.eventLog.dir) doesn't already exist, the SparkContext fails to start. We should try to automatically create this directory.

Issue Links

• links to: [Github] Pull Request #9082 (kayousterhout)