[FLINK-13987] Better TM/JM Log Display

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Runtime / REST
• Assignee: lining
• Reporter: lining
• Created: 06/Sep/19 07:56
• Updated: 29/Dec/20 10:28
• Resolved: 18/May/20 09:05

Description

As the job running, the log files are becoming large.

As the application runs on JVM, sometimes the user needs to see the log of GC, but there isn't this content.

Above all, we need new apis:

•  list taskmanager all log file
  • /taskmanagers/taskmanagerid/logs

  • {
      "logs": [
        {
          "name": "taskmanager.log",
          "size": 12529
        }
      ]
    } 

• read taskmanager log file
  •  /taskmanagers/logs/[filename]
  • response: same as taskmanager’s log
• list jobmanager all log file
  • /jobmanager/logs

  • {
      "logs": [
        {
          "name": "jobmanager.log",
          "size": 12529
        }
      ]
    }

• read jobmanager log file
  •  /jobmanager/logs/[filename]
  • response: same as jobmanager's log

Issue Links

• is duplicated by: FLINK-9536 Rolling logs using log4j.properties, prevents them from showing on the UI.
• is duplicated by: FLINK-11782 Enhance TaskManager log visualization by listing all log files for Flink web UI
• is related to: FLINK-10002 WebUI shows logs unfriendly, especially when the amount of logs is large
• relates to: FLINK-11782 Enhance TaskManager log visualization by listing all log files for Flink web UI
• mentioned in: Page Loading...