Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
0.1.0
-
None
-
None
-
None
Description
We previously added our interpreter plugin by adding
"SPARK_OPTS": "--jars file:/path/to/our.jar",
to kernel.json.
This no longer works, we get a message that the interpreter was not found.
We discovered if we modified the --driver-class-path in toree/run.sh to include our jar, the interpreter was found.
SPARK_OPTS="--driver-class-path=\"${TOREE_ASSEMBLY}:/path/to/our.jar\" ${SPARK_OPTS}"
Unfortunately, this cannot be specified in the kernel.json, because the TOREE_ASSEMBLY would be lost.
A new ENV var could be added (i.e. TOREE_DRIVER_JAR)
SPARK_OPTS="--driver-class-path=\"${TOREE_ASSEMBLY}:${TOREE_DRIVER_JAR}:\" ${SPARK_OPTS}"
which we could specifiy in our kernel.json