[FLINK-10002] WebUI shows logs unfriendly, especially when the amount of logs is large

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Runtime / Web Frontend
• Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned pull-request-available
• Assignee: Unassigned
• Reporter: Xinyu Zhang
• Created: 31/Jul/18 10:25
• Updated: 28/Dec/21 22:38

Description

When a streaming job run for a long time, the amount of logs may be very large. The current WebUI shows all content of logs. It will cost much time to download logs from task managers. and the browser cannot display the logs.

Therefore, I suggest that Flink uses DailyRollingAppender to split logs by default, and task manager provides an API that can get logs based on a parameter of time interval. In this way WebUI can display logs based on time interval.

Issue Links

• relates to: FLINK-13987 Better TM/JM Log Display
• relates to: FLINK-10306 Support the display of log file from any position on webUI
• links to: GitHub Pull Request #6770