[ZEPPELIN-2368] Option to run all paragraphs *sequentially*

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.1
• Fix Version/s: 0.8.0
• Component/s: Core, zeppelin-server
• Assignee: Jeff Zhang
• Reporter: Ruslan Dautkhanov
• Created: 06/Apr/17 17:02
• Updated: 03/Mar/18 05:01
• Resolved: 28/Oct/17 09:08

Description

A user on zeppelin's user email list:

I often have notebooks that have a %sh as the 1st paragraph. This scps some file from another server, and then a number of spark or sparksql paragraphs are after that.

If I click on the run-all paragraphs at the top of the notebook the 1st %sh paragraph kicks off as expected, but the 2nd %spark notebook starts too at the same time. The others go into pending state and then start once the spark one has completed.

Is this a bug? Or am I doing something wrong?

Quoting moon

That's expected behavior at the moment. The reason is

Each interpreter has it's own scheduler (either FIFO, Parallel), and run-all just submit all paragraphs into target interpreter's scheduler.

I think we can add feature such as run-all-sequentially.

Issue Links

• is a parent of: ZEPPELIN-3095 Fix UI when all paragraphs executing sequentially
• is related to: ZEPPELIN-3286 Run All Paragraphs stops if there is a disabled paragraph mid-run
• links to: GitHub Pull Request #2619
• links to: GitHub Pull Request #2627