[ZEPPELIN-4050] Zeppelin on YARN

• Type: New Feature
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 0.9.0
• Assignee: Xun Liu
• Reporter: Xun Liu
• Created: 11/Mar/19 04:35
• Updated: 02/Jun/19 00:28

Description

Make Zeppelin run on YARN environment.

RUN MODE: All run YARN container

 - Run Zeppelin server as a docker container

 - Zeppelin server with YARN API to create/delete container for interpreters

RUN MODE: Only interpreter run YARN container

 - Run Zeppelin server on local host.

 - Run Standard interpreters as YARN (Docker) container 

 - Spark remains unchanged.

Development Plan

1. Run Hadoop Submarine interpreters as YARN (Docker) container 
2. Run Standard interpreters as YARN (Docker) container 
3. Run Zeppelin daemon as a docker container
4. Spark remains unchanged.

Issue Links

• Dependency: ZEPPELIN-3856 Zeppelin add Hadoop Submarine (machine learning) interpreter
• links to: GitHub Pull Request #3354
• links to: Submarine interpreter design doc