[ZEPPELIN-3856] Zeppelin add Hadoop Submarine (machine learning) interpreter

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Assignee: Xun Liu
• Reporter: Xun Liu
• Created: 08/Nov/18 03:45
• Updated: 12/Mar/19 04:37

Description

Hadoop Submarine is the latest machine learning framework subproject in the Hadoop 3.2 release. It allows Hadoop to support Tensorflow, MXNet,Caffe, Spark, etc. A variety of deep learning frameworks provide a full-featured system framework for machine learning algorithm development, distributed model training, model management, and model publishing, combined with hadoop's intrinsic data storage and data processing capabilities to enable data scientists to Good mining and the value of the data.
 
I was involved in the development of the hadoop submarine project. So I plan to add the interpreter module of hadoop submarine to zeppelin.
Let zeppeline increase the development of deep learning. This is my design document, let's see if there is any opinion, you can put it directly in the document, thank you!
https://docs.google.com/document/d/16YN8Kjmxt1Ym3clx5pDnGNXGajUT36hzQxjaik1cP4A/edit?ts=5bc6bfdd

Issue Links

• Dependency: ZEPPELIN-4050 Zeppelin on YARN
• Dependency: ZEPPELIN-4018 [Umbrella] Workflow and orchestration
• relates to: ZEPPELIN-3881 Adding BigDL as a dependency to Spark interpreter causes indefinite pending cells, UI instability.
• links to: Submarine interpreter design doc

Sub-Tasks

• Paragraph config default value can be customized: Closed
• Execute paragraph to support custom menu display with multiple URL links: Closed
• Redisplay angularObjectBind when the note is reopened: Closed
• Interpreter process get the note from zeppelin server: Closed
• Hadoop Submarine interpreter: Closed