[ZEPPELIN-1584] (Windows) Zeppelin on Windows 10 fails to load conf and interpreter

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.6.2
• Component/s: Core, Interpreters

Environment

• Notebook w/ i5-5200 CPU / 16GB RAM
• Windows 10 Home Anniversary (64-bit Version 10.0.14393)
• Chrome 53.0.2785.143 m (64-bit)
• Spark 2.0.1 installed to C:\spark
• Zeppelin 0.6.2 download (prebuilt) installed to C:\zeppelin
• java version "1.8.0_112" installed to C:\Program Files\Java\jre1.8.0_112
• jdk version "1.8.0_112" installed to C:\Program Files\Java\jdk1.8.0_112
• Windows environment %JAVA_HOME%, %JDK_HOME%, %SPARK_HOME%, and %HADOOP_HOME% set via Windows 10 "Advanced system settings"
• Current setup successfully runs spark 2.0.1 through spark-shell, spark-submit, ScalaIDE, and IntelliJ
• Run from cmd (both as user and as administrator):
  • c:\zeppelin\bin>zeppelin.cmd
  • c:\zeppelin\bin>zeppelin.cmd --config ../conf
  • I have also tried running all of the cmd files in bin as well as zeppelin-env.cmd before running zeppelin.cmd

• Assignee: Unassigned
• Reporter: Dustin DeMeo
• Created: 27/Oct/16 07:50
• Updated: 14/Sep/17 09:09

Description

Hi moon, Pallavi, and [e-mail]

This issue is similar to ZEPPELIN-647 (see last comment) and ZEPPELIN-1506 except I was able to create a notebook and I couldn't find any errors related to JSP support in the log.

Two issues I cannot seem to resolve are:

1. zeppelin does not load the configuration file
2. The UI opens but spark does not run the code because zeppelin cannot create an interpreter

Note, I tried to invoke the embedded spark interpreter directly with cmd (as found in the zeppelin log) and got the following error:

Relevant cmd stdout

C:\Users\lab>c:\zeppelin\bin\interpreter.cmd -d c:\zeppelin\interpreter\spark -p 60076 -l c:\zeppelin/local-repo/2C2APP9EQ
The filename, directory name, or volume label syntax is incorrect.

I tried changing the / to \ and got the same error:

Relevant cmd stdout

C:\Users\lab>c:\zeppelin\bin\interpreter.cmd -d c:\zeppelin\interpreter\spark -p 60076 -l c:\zeppelin\local-repo\2C2APP9EQ
The filename, directory name, or volume label syntax is incorrect.

I noticed that the local-repo/[] folder wasn't created so I created it, tried to invoke the embedded spark interpreter from cmd again, and got the new error:

Relevant cmd stdout

C:\Users\lab>mkdir c:\zeppelin\local-repo\2C2APP9EQ
C:\Users\lab>c:\zeppelin\bin\interpreter.cmd -d c:\zeppelin\interpreter\spark -p 60076 -l c:\zeppelin\local-repo\2C2APP9EQ
The system cannot find the path specified.

I have attached relevant information, screenshots, and logs. Below are some interesting errors/warnings/info.

Thanks

Relevant ZEPPELIN_HOME/conf/zeppelin-env.cmd

set ZEPPELIN_JAVA_OPTS=-Dspark.driver.memory=10g -Dspark.cores.max=2
set SPARK_HOME=C:\spark

Relevant cmd stdout

c:\zeppelin\bin>zeppelin.cmd
...
WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.InterpreterRestApi.listInterpreter(java.lang.String), should not consume any entity.
WARNING: A sub-resource method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.NotebookRestApi.createNote(java.lang.String) throws java.io.IOException, with URI template, "/", is treated as a resource method
WARNING: A sub-resource method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.NotebookRestApi.getNotebookList() throws java.io.IOException, with URI template, "/", is treated as a resource method
The filename, directory name, or volume label syntax is incorrect.

Relevant ZEPPELIN_HOME/logs/10_26.log

WARN [2016-10-27 00:03:27,486] (

Unknown macro: {main}

ZeppelinConfiguration.java[create]:94) - Failed to load configuration, proceeding with a default
...
ERROR [2016-10-27 00:03:29,981] (

Interpreter.java[register]:315) - Static initialization is deprecated. You should change it to use interpreter-setting.json in your jar or interpreter/

Unknown macro: {interpreter}

/interpreter-setting.json
INFO [2016-10-27 00:03:29,981] (

Unknown macro: {main}

InterpreterFactory.java[init]:154) - Interpreter python.python found. class=org.apache.zeppelin.python.PythonInterpreter
INFO [2016-10-27 00:03:30,000] (

InterpreterFactory.java[init]:154) - Interpreter sh.sh found. class=org.apache.zeppelin.shell.ShellInterpreter
INFO [2016-10-27 00:03:30,422] (

Unknown macro: {main}

InterpreterFactory.java[init]:154) - Interpreter spark.spark found. class=org.apache.zeppelin.spark.SparkInterpreter
...
INFO [2016-10-27 00:05:42,207] (

Unknown macro: {pool-1-thread-2}

RemoteInterpreterProcess.java[reference]:148) - Run interpreter process [c:\zeppelin\bin\interpreter.cmd, -d, c:\zeppelin\interpreter\spark, -p, 59903, -l, c:\zeppelin/local-repo/2C2APP9EQ]
INFO [2016-10-27 00:05:42,292] (

Unknown macro: {Exec Default Executor}

RemoteInterpreterProcess.java[onProcessFailed]:288) - Interpreter process failed {}
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
...

Issue Links

• relates to: ZEPPELIN-2440 [Umbrella] Platform Compatibility Issues