[SUBMARINE-230] [Umbrella] Submarine Interpreter Module

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Component/s: Workbench Interpreter
• Target Version: 0.5.0
• Assignee: Liu Xun
• Reporter: Liu Xun
• Created: 11/Oct/19 02:01
• Updated: 21/Jul/20 04:37
• Resolved: 21/Jul/20 04:37

Description

Because the user needs to write code and execution in the workbench (such as executing Python, Spark sql), in order to avoid user resource competition and code security control when the user executes the code, Workbench will create a Docker container for each user, User can write code in own container, bind the Github account for code version management, execute python and spark programs.

2. Interpreter
Submarine provides multi-language execution for notebooks in workbench through interpreters in a variety of programming languages (for example, python interpreter, spark interpreter).

2.1 Interpreter execution flow
1. The user enters the code in the workbench notebook and clicks the execute button. First the workbench server starts the interpreter process.
2. The workbench server sends the user's code to the interpreter process via the interface for execution, and gets the execution result, returning to the workbench notebook for display.

Design doc: https://docs.google.com/document/d/1LJc5hRTWfIs6K5f7vMgGC_FUizeQf-qqiWICqO8SoR8/edit#

Issue Links

• is related to: SUBMARINE-165 [Umbrella] Submarine Workbench
• relates to: SUBMARINE-98 [Umbrella] Submarine web page
• relates to: SUBMARINE-232 [Umbrella] Custom Zeppelin Submodule
• links to: Submarine Workbench Design

Sub-Tasks

• [Interpreter] Introducing zeppelin via submodule: Resolved
• [Interpreter] Submarine Python Interpreter: Resolved
• Interpreter support cluster mode: Resolved
• Temporarily disable the interpreter module: Resolved
• Enable interpreter module: Resolved