[SPARK-15218] Error: Could not find or load main class org.apache.spark.launcher.Main when run from a directory containing colon ':'

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.6.1
• Component/s: Spark Core, Spark Shell, Spark Submit
• Labels: mesos
• Assignee: Unassigned
• Reporter: Adam Cecile
• Created: 09/May/16 06:07
• Updated: 08/Dec/16 21:00
• Resolved: 08/Dec/16 21:00

Description

mkdir /tmp/qwe:rtz
cd /tmp/qwe:rtz
wget http://www-eu.apache.org/dist/spark/spark-1.6.1/spark-1.6.1-bin-without-hadoop.tgz
tar xvzf spark-1.6.1-bin-without-hadoop.tgz 
cd spark-1.6.1-bin-without-hadoop/
bin/spark-submit

Returns "Error: Could not find or load main class org.apache.spark.launcher.Main".

That would not be such an issue if Mesos executor did not have colon in the generated paths. It means withtout hacking (define relative SPARK_HOME path by myself) there's no way to run a spark-job insode a mesos job container...

Best regards, Adam.

Issue Links

• links to: [Github] Pull Request #13026 (sayevsky)