[SPARK-1933] FileNotFoundException when a directory is passed to SparkContext.addJar/addFile

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.1, 1.1.0
• Component/s: Spark Core
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 27/May/14 03:17
• Updated: 18/Jun/14 07:39
• Resolved: 18/Jun/14 07:39

Description

When SparkContext.addJar/addFile is used to add a directory (which is not supported), the runtime exception is

java.io.FileNotFoundException: [file] (No such file or directory)

This exception is extremely confusing because the directory does exist. We should throw a more meaningful exception when a directory is passed to addJar/addFile.