[FLINK-2313] Change Streaming Driver Execution Model

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: API / DataStream
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Stephan Ewen
• Created: 02/Jul/15 09:52
• Updated: 10/Feb/22 10:37

Description

I would propose the following change to the Streaming Execution Environment:

When calling env.execute(), it does not block, but return an ExecutionContext object. This execution context has various methods, that allow you to control the execution:

• waitFor() -> Blocks until the job terminates, or the connection to the JobManager is lost.
• stop() -> initiates a clean stop
• cancel() -> cancels the program
• setParallelism() -> Later: adjusts the parallelism of the program

If this is voted as desirable, I would make a design how to do this...

Issue Links

• Is contained by: FLINK-4272 Create a JobClient for job control and monitoring
• is duplicated by: FLINK-4828 execute stream job asynchronously
• relates to: FLINK-3133 Introduce collect()/count()/print() methods in DataStream API