[FLINK-13987] Better TM/JM Log Display

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Runtime / REST
• Assignee: lining
• Reporter: lining
• Created: 06/Sep/19 07:56
• Updated: 29/Dec/20 10:28
• Resolved: 18/May/20 09:05

Description

As the job running, the log files are becoming large.

As the application runs on JVM, sometimes the user needs to see the log of GC, but there isn't this content.

Above all, we need new apis:

•  list taskmanager all log file
  • /taskmanagers/taskmanagerid/logs

  • {
      "logs": [
        {
          "name": "taskmanager.log",
          "size": 12529
        }
      ]
    } 

• read taskmanager log file
  •  /taskmanagers/logs/[filename]
  • response: same as taskmanager’s log
• list jobmanager all log file
  • /jobmanager/logs

  • {
      "logs": [
        {
          "name": "jobmanager.log",
          "size": 12529
        }
      ]
    }

• read jobmanager log file
  •  /jobmanager/logs/[filename]
  • response: same as jobmanager's log

Issue Links

• is duplicated by: FLINK-9536 Rolling logs using log4j.properties, prevents them from showing on the UI.
• is duplicated by: FLINK-11782 Enhance TaskManager log visualization by listing all log files for Flink web UI
• is related to: FLINK-10002 WebUI shows logs unfriendly, especially when the amount of logs is large
• relates to: FLINK-11782 Enhance TaskManager log visualization by listing all log files for Flink web UI
• mentioned in: Page Loading...

Sub-Tasks

• Add Rest Handler to list TM Logfiles and enable reading Logs by Filename: Closed
• Add Rest Handler to list JM Logfiles and enable reading Logs by Filename: Closed
• Web UI: Enable listing TM Logs and displaying Logs by Filename: Closed
• Web UI: Enable listing JM Logs and displaying Logs by Filename: Closed
• Add TM log and stdout page back: Closed