[ZEPPELIN-4931] Is it possible to establish spark properties in zeppelin-env.sh

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: interpreter-setting, Interpreters, spark
• Assignee: Unassigned
• Reporter: David Lacalle Castillo
• Created: 01/Jul/20 13:27
• Updated: 01/Jul/20 20:55

Description

I would like to be able to establish spark.serializer and spark.jars.packages in zeppelin-env.sh.

So spark interpreter starts ups with this properties loaded in my container.

I have tried to add to zeppelin-env.sh the following lines:
export spark.serializer=org.apache.spark.serializer.KryoSerializer
export spark.jars.packages=org.apache.hudi:hudi-spark-bundle_2.11:0.5.3,org.apache.spark:spark-avro_2.11:2.4.5
 
However, in Zeppelin Interpreter UI I am not seeing them?
Is there any way of achieving it?