[ZEPPELIN-5394] Kubernetes - Option to have zeppelin kill existing idle interpreter to spawn new one

• Type: Wish
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Component/s: Kubernetes, spark
• Assignee: Unassigned
• Reporter: Theo Sardin
• Created: 28/May/21 06:49
• Updated: 31/May/21 01:50

Description

Hello,

 

We have a Zeppelin running on kubernetes, but when too many users are using it / too many notes are ran we end up with too many interpreter pods, eating all the quotas for the kube namespace, and having Kubernetes timeout for all subsequent runs.

 

Would there be any way to have a config options to kill an interpreter that's not running anything at this specific moment in order to spawn any new one ?

 

Thanks and regards