[ZEPPELIN-5644] Reduce redundancy during the interpreter execution process

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 0.11.0
• Component/s: Interpreters
• Assignee: Sun Shun
• Reporter: Sun Shun
• Created: 28/Jan/22 10:12
• Updated: 18/Mar/22 14:44
• Resolved: 18/Mar/22 00:00

Description

Hi, I found some issues when trying to investigate the spark OOM issue:

1. Thread of interpreter executor hasn't been closed when interpreter is restarted;
2. When restart from notebook page, the Zeppelin Daemon are going to close all interpreters, while Zeppelin interpreter server only close the opened interpreters indeed, and it causes in duplicated interpreters kept in server side;
3. After one user starts multi spark sessions, duplicated loaded Classes are founded for the innerScalaInterpreter inside the spark interpreter, since the threads are created in different sub threads, and they don't share loaded class.

I will create a PR to solve the above issues.