[ZEPPELIN-2944] Cannot launch Spark interpreter for non-local mode

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Component/s: Interpreters
• Assignee: Tae Jun Kim
• Reporter: Tae Jun Kim
• Created: 20/Sep/17 13:19
• Updated: 26/Sep/17 05:38
• Resolved: 26/Sep/17 05:38

Description

SPARK_HOME is specified but I got

java.lang.RuntimeException: SPARK_HOME is not specified for non-local mode
	at org.apache.zeppelin.interpreter.InterpreterSetting.setupPropertiesForSparkR(InterpreterSetting.java:783)
	at org.apache.zeppelin.interpreter.InterpreterSetting.getEnvFromInterpreterProperty(InterpreterSetting.java:741)
	at org.apache.zeppelin.interpreter.InterpreterSetting.createInterpreterProcess(InterpreterSetting.java:712)
	at org.apache.zeppelin.interpreter.ManagedInterpreterGroup.getOrCreateInterpreterProcess(ManagedInterpreterGroup.java:58)
	at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getOrCreateInterpreterProcess(RemoteInterpreter.java:98)
	at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:153)
	at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:126)
	at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:265)
	at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:423)
	at org.apache.zeppelin.scheduler.Job.run(Job.java:182)
	at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:307)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:473)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

It's because of the line at InterpreterSetting.java:

    setupPropertiesForSparkR(sparkProperties, javaProperties.getProperty("SPARK_HOME"));

This should be:

    setupPropertiesForSparkR(sparkProperties, System.getenv("SPARK_HOME"));

Issue Links

• links to: GitHub Pull Request #2594