Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4904

YARN Log tooling enhancements

          Details

          • Type: Improvement
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: None
          • Fix Version/s: None
          • Component/s: None
          • Labels:
            None

            Attachments

            1.
            		 "yarn logs" command should not require the appOwner argument Sub-task Resolved Xuan Gong
            2.
            		 Improve "yarn logs" command-line to optionally show log metadata also Sub-task Resolved Xuan Gong
            3.
            		 Yarn logs should take a -out option to write to a directory Sub-task Resolved Xuan Gong
            4.
            		 Yarn logs should support a option to output logs as compressed archive Sub-task Resolved Unassigned
            5.
            		 ATS/NM should support a link to dowload/get the logs in text format Sub-task Resolved Xuan Gong
            6.
            		 Improve yarn logs to fetch container logs without specifying nodeId Sub-task Resolved Xuan Gong
            7.
            		 Re-direction of a particular log file within in a container in NM UI does not redirect properly to Log Server ( history ) on container completion Sub-task Resolved Xuan Gong
            8.
            		 Refactory ContainersLogsBlock, AggregatedLogsBlock and container log webservice introduced in AHS to minimize the duplication. Sub-task Open Xuan Gong
            9.
            		 Add support for zipping/unzipping logs while in transit for the NM logs web-service Sub-task Open Xuan Gong
            10.
            		 Replace RPC calls with WebService calls in LogsCLI Sub-task Resolved Xuan Gong
            11.
            		 Improve "yarn log" command-line to read the last K bytes for the log files Sub-task Resolved Xuan Gong
            12.
            		 Improve "yarn log" command-line "logFiles" option to support regex Sub-task Resolved Xuan Gong
            13.
            		 Avoid setting CONTENT-DISPOSITION header in the container-logs web-service Sub-task Resolved Xuan Gong
            14.
            		 "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete Sub-task Resolved Jian He
            15.
            		 Get Container logs for the Running application from Yarn Logs CommandLine Sub-task Resolved Xuan Gong
            16.
            		 Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices Sub-task Resolved Xuan Gong
            17.
            		 LogReader not closed in AHSWebServices and FileInputStream not closed in NMWebServices while reading container logs Sub-task Resolved Varun Saxena
            18.
            		 Close LogReader in in AHSWebServices#getStreamingOutput and FileInputStream in NMWebServices#getLogs Sub-task Resolved Xuan Gong
            19.
            		 Improve yarn logs to get Container List Sub-task Resolved Xuan Gong
            20.
            		 Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM Sub-task Resolved Xuan Gong
            21.
            		 Close FileInputStream in NMWebServices#getLogs in branch-2.8 Sub-task Resolved Xuan Gong
            22.
            		 Container line in yarn logs output for a live application should include the hostname for the container Sub-task Resolved Xuan Gong
            23.
            		 Logs for a completed container are not available in the yarn logs output for a live application Sub-task Resolved Xuan Gong
            24.
            		 remove AHS enable check from LogsCLI#fetchAMContainerLogs Sub-task Resolved Xuan Gong
            25.
            		 yarn logs command: no need to specify -applicationId when specifying containerId Sub-task Resolved Gergely Novák
            26.
            		 obtaining app logs for last 'n' bytes using CLI gives 'java.io.IOException' Sub-task Resolved Xuan Gong
            27.
            		 TestLogsCLI#testFetchApplictionLogs fails in trunk/branch-2 Sub-task Resolved Xuan Gong
            28.
            		 app logs with 'n' bytes via CLI fails with NumberFormatException Sub-task Resolved Xuan Gong
            29.
            		 Yarn CLI to obtain App logs for last 'n' bytes fails with 'java.io.IOException' and for 'n' bytes fails with NumberFormatException Sub-task Resolved Xuan Gong
            30.
            		 Obtaining logs for completed container says 'file belongs to a running container ' at the end Sub-task Resolved Xuan Gong
            31.
            		 For AM containers, or for containers of running-apps, "yarn logs" incorrectly only (tries to) shows syslog file-type by default Sub-task Resolved Vinod Kumar Vavilapalli
            32.
            		 Improve Yarn logs command to get container logs based on Node Id Sub-task Patch Available Xuan Gong
            33.
            		 Parameter 'size' in the webservices "/containerlogs/$containerid/$filename" and in AHSWebServices is semantically confusing Sub-task Open Vinod Kumar Vavilapalli
            34.
            		 Differentiate exactly match with regex in yarn log CLI Sub-task Resolved Xuan Gong
            35.
            		 Unable to access logs for a running application if YARN_ACL_ENABLE is enabled Sub-task Resolved Xuan Gong
            36.
            		 Yarn live log aggregation does not throw if command line arg is wrong Sub-task Resolved Xuan Gong
            37.
            		 Add a new web service to list the files on a container in AHSWebService Sub-task Resolved Xuan Gong
            38.
            		 Improve webservice to list aggregated log files Sub-task Resolved Xuan Gong
            39.
            		 improve YARN webservice to output aggregated container logs Sub-task Resolved Xuan Gong
            40.
            		 Improve AHS webservice to accept NM address as a parameter to get container logs Sub-task Resolved Xuan Gong
            41.
            		 re-direct NM Web Service to get container logs for finished applications Sub-task Resolved Xuan Gong
            42.
            		 Add a service to fetch a given list of log files, to a single archive Sub-task Open Xuan Gong
            43.
            		 Obtaining app logs for Running application fails with "Unable to parse json from webservice. Error:" Sub-task Resolved Xuan Gong
            44.
            		 yarn logs cli should provide logs for a completed container even when application is still running Sub-task Resolved Xuan Gong
            45.
            		 Potential infinite redirection on YARN log redirection web service Sub-task Resolved Xuan Gong
            46.
            		 YARN logs CLI needs alway check containerLogsInfo/containerLogInfo before parse the JSON object from NMWebService Sub-task Resolved Xuan Gong
            47.
            		 Add a size threshold beyond which yarn logs will require a force option Sub-task Resolved Xuan Gong
            48.
            		 Add retry logic in LogsCLI when fetch running application logs Sub-task Resolved Xuan Gong
            49.
            		 Document Log CLI in YarnCommands.md Sub-task Open Unassigned

              Activity

                People

                • Assignee:
                  xgong Xuan Gong
                  Reporter:
                  xgong Xuan Gong
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  16 Start watching this issue

                  Dates

                  • Created:
                    Updated: