[FLINK-2357] New JobManager Runtime Web Frontend

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 0.10.0
• Component/s: Runtime / Web Frontend
• Assignee: Stephan Ewen
• Reporter: Stephan Ewen
• Created: 14/Jul/15 15:55
• Updated: 02/Oct/19 17:45
• Resolved: 17/Sep/15 18:26

Description

We need to improve rework the Job Manager Web Frontend.

The current web frontend is limited and has a lot of design issues

• It does not display and progress while operators are running. This is especially problematic for streaming jobs
• It has no graph representation of the data flows
• it does not allow to look into execution attempts
• it has no hook to deal with the upcoming live accumulators
• The architecture is not very modular/extensible

I propose to add a new JobManager web frontend:

• Based on Netty HTTP (very lightweight)
• Using rest-style URLs for jobs and vertices
• integrating the D3 graph renderer of the previews with the runtime monitor
• with details on execution attempts
• first class visualization of records processed and bytes processed

Issue Links

• relates to: FLINK-2844 Remove old web interface and default to the new one

Sub-Tasks

• Add Netty-HTTP based server and server handlers: Closed
• Add dashboard frontend architecture amd build infrastructue: Closed
• Unify two backend servers to one server: Closed
• Chow execution config in dashboard: Closed
• Link nodes in plan to vertices: Closed
• Provide Cluster Status Info: Closed
• Extend job data in job list: Closed
• Add exception reporting handler: Closed
• Moniroting api / web dashboard: Create request handlers list subtask details and accumulators: Closed
• Add documentation about monitoring api: Closed