[ZEPPELIN-3471] [Umbrella] Distributed zeppelin cluster services

• Type: New Feature
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Component/s: zeppelin-server
• Flags: Important
• Docs Text: https://docs.google.com/document/d/1a8QLSyR3M5AhlG1GIYuDTj6bwazeuVDKCRRBm-Qa3Bw/edit?usp=sharing
• Assignee: Xun Liu
• Reporter: Xun Liu
• Created: 18/May/18 02:08
• Updated: 12/Mar/21 13:03

Description

1. At present, Zeppelin's Interpreter is only started on the same machine of the Zeppelin server. It cannot provide load balancing capability and more reasonable server resource utilization for high availability and a large number of users.
2. Zeppelin-server needs to provide multiple copy services on multiple servers;
3. Each zeppelin-server manages the life cycle of Interpreter processes running on this machine;
4. The Interpreter process can be started on any server through any zeppelin-web;

Please refer to on-going design doc, and add your thoughts:https://docs.google.com/document/d/1a8QLSyR3M5AhlG1GIYuDTj6bwazeuVDKCRRBm-Qa3Bw/edit?usp=sharing

Issue Links

• relates to: ZEPPELIN-4104 Zeppelin Interpreter On Docker

Sub-Tasks

• Choose which server to run the interpreter process: Open
• Cluster Session module design: Open
• View the zeppelin service log in the cluster management page: Open
• Restart the zeppelin service in the cluster management page: Open
• Restart the zeppelin interpreter in the cluster management page: Open
• Optimized cluster metadata calculation interpreter offline status: Open