Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4904

YARN Log tooling enhancements

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Attachments

      1.
      "yarn logs" command should not require the appOwner argument Sub-task Resolved Xuan Gong
      2.
      Improve "yarn logs" command-line to optionally show log metadata also Sub-task Resolved Xuan Gong
      3.
      Yarn logs should take a -out option to write to a directory Sub-task Resolved Xuan Gong
      4.
      Yarn logs should support a option to output logs as compressed archive Sub-task Resolved Unassigned
      5.
      ATS/NM should support a link to dowload/get the logs in text format Sub-task Resolved Xuan Gong
      6.
      Improve yarn logs to fetch container logs without specifying nodeId Sub-task Resolved Xuan Gong
      7.
      Re-direction of a particular log file within in a container in NM UI does not redirect properly to Log Server ( history ) on container completion Sub-task Resolved Xuan Gong
      8.
      Refactory ContainersLogsBlock, AggregatedLogsBlock and container log webservice introduced in AHS to minimize the duplication. Sub-task Open Xuan Gong
      9.
      Add support for zipping/unzipping logs while in transit for the NM logs web-service Sub-task Open Xuan Gong
      10.
      Replace RPC calls with WebService calls in LogsCLI Sub-task Resolved Xuan Gong
      11.
      Improve "yarn log" command-line to read the last K bytes for the log files Sub-task Resolved Xuan Gong
      12.
      Improve "yarn log" command-line "logFiles" option to support regex Sub-task Resolved Xuan Gong
      13.
      Avoid setting CONTENT-DISPOSITION header in the container-logs web-service Sub-task Resolved Xuan Gong
      14.
      "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete Sub-task Resolved Jian He
      15.
      Get Container logs for the Running application from Yarn Logs CommandLine Sub-task Resolved Xuan Gong
      16.
      Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices Sub-task Resolved Xuan Gong
      17.
      LogReader not closed in AHSWebServices and FileInputStream not closed in NMWebServices while reading container logs Sub-task Resolved Varun Saxena
      18.
      Close LogReader in in AHSWebServices#getStreamingOutput and FileInputStream in NMWebServices#getLogs Sub-task Resolved Xuan Gong
      19.
      Improve yarn logs to get Container List Sub-task Resolved Xuan Gong
      20.
      Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM Sub-task Resolved Xuan Gong
      21.
      Close FileInputStream in NMWebServices#getLogs in branch-2.8 Sub-task Resolved Xuan Gong
      22.
      Container line in yarn logs output for a live application should include the hostname for the container Sub-task Resolved Xuan Gong
      23.
      Logs for a completed container are not available in the yarn logs output for a live application Sub-task Resolved Xuan Gong
      24.
      remove AHS enable check from LogsCLI#fetchAMContainerLogs Sub-task Resolved Xuan Gong
      25.
      yarn logs command: no need to specify -applicationId when specifying containerId Sub-task Resolved Gergely Novák
      26.
      obtaining app logs for last 'n' bytes using CLI gives 'java.io.IOException' Sub-task Resolved Xuan Gong
      27.
      TestLogsCLI#testFetchApplictionLogs fails in trunk/branch-2 Sub-task Resolved Xuan Gong
      28.
      app logs with 'n' bytes via CLI fails with NumberFormatException Sub-task Resolved Xuan Gong
      29.
      Yarn CLI to obtain App logs for last 'n' bytes fails with 'java.io.IOException' and for 'n' bytes fails with NumberFormatException Sub-task Resolved Xuan Gong
      30.
      Obtaining logs for completed container says 'file belongs to a running container ' at the end Sub-task Resolved Xuan Gong
      31.
      For AM containers, or for containers of running-apps, "yarn logs" incorrectly only (tries to) shows syslog file-type by default Sub-task Resolved Vinod Kumar Vavilapalli
      32.
      Improve Yarn logs command to get container logs based on Node Id Sub-task Patch Available Xuan Gong
      33.
      Parameter 'size' in the webservices "/containerlogs/$containerid/$filename" and in AHSWebServices is semantically confusing Sub-task Open Vinod Kumar Vavilapalli
      34.
      Differentiate exactly match with regex in yarn log CLI Sub-task Resolved Xuan Gong
      35.
      Unable to access logs for a running application if YARN_ACL_ENABLE is enabled Sub-task Resolved Xuan Gong
      36.
      Yarn live log aggregation does not throw if command line arg is wrong Sub-task Resolved Xuan Gong
      37.
      Add a new web service to list the files on a container in AHSWebService Sub-task Resolved Xuan Gong
      38.
      Improve webservice to list aggregated log files Sub-task Resolved Xuan Gong
      39.
      improve YARN webservice to output aggregated container logs Sub-task Resolved Xuan Gong
      40.
      Improve AHS webservice to accept NM address as a parameter to get container logs Sub-task Resolved Xuan Gong
      41.
      re-direct NM Web Service to get container logs for finished applications Sub-task Resolved Xuan Gong
      42.
      Add a service to fetch a given list of log files, to a single archive Sub-task Open Xuan Gong
      43.
      Obtaining app logs for Running application fails with "Unable to parse json from webservice. Error:" Sub-task Resolved Xuan Gong
      44.
      yarn logs cli should provide logs for a completed container even when application is still running Sub-task Resolved Xuan Gong
      45.
      Potential infinite redirection on YARN log redirection web service Sub-task Resolved Xuan Gong
      46.
      YARN logs CLI needs alway check containerLogsInfo/containerLogInfo before parse the JSON object from NMWebService Sub-task Resolved Xuan Gong
      47.
      Add a size threshold beyond which yarn logs will require a force option Sub-task Resolved Xuan Gong
      48.
      Add retry logic in LogsCLI when fetch running application logs Sub-task Resolved Xuan Gong
      49.
      Document Log CLI in YarnCommands.md Sub-task Open Unassigned

      Activity

        People

          xgong Xuan Gong
          xgong Xuan Gong
          Votes:
          0 Vote for this issue
          Watchers:
          16 Start watching this issue

          Dates

            Created:
            Updated: