[FLINK-14147] Reduce REST API Request/Response redundancy

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Runtime / Web Frontend
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Yadong Xie
• Created: 20/Sep/19 08:31
• Updated: 22/Nov/21 10:40

Description

1. Redundancy Response

In the response of API /jobs/:jobid, the id and name in both plan and the vertices data are exactly the same, it would waste a lot of network bandwidth if the vertex graph is very big(1000+ vertex in a job).

2. Redundancy Request
In the current Web UI design, we have to query vertex number times to display the low watermarks in the job graph. If the vertex number is very large(1000+ sometimes), the Web UI will send 1000+ request to the REST API, the max concurrent HTTP request in a browser is limited, it would bring a long time delay for users. Test it, if there are more than 165 WarterMarks to call will redirect to /bad-request, then 404.

Issue Links

• relates to: FLINK-14470 Watermark display not working with high parallelism job