[FLINK-5312] Implement Standalone Setup v2.0

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Component/s: Runtime / Coordination
• Assignee: Unassigned
• Reporter: Manu Zhang
• Created: 10/Dec/16 11:26
• Updated: 13/Sep/19 23:14
• Resolved: 13/Sep/19 13:11

Description

Copied from FLIP-6

A future version of the Standalone Setup could be thought of to implement something like a “lightweight Yarn” architecture:

• All nodes run a simple “NodeManager” process that spawns processes for the TaskManagers and JobManagers, that way offering proper isolation of jobs against each other.
• The LocalDispatcher will not spawn the JobManager internally but on a lightweight “node manager”

Issue Links

• relates to: FLINK-4319 Rework Cluster Management (FLIP-6)