Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10025

Various improvements in YARN log servlets

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.2.1
    • None
    • yarn
    • None

    Description

      There are multiple ways how we can enhance the current log servlets in YARN.

      Attachments

        1. YARN-10025 document.pdf
          60 kB
          Adam Antal

        Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-4993 Refactory ContainersLogsBlock, AggregatedLogsBlock and container log webservice introduced in AHS to minimize the duplication.

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. YARN-6080 Create WebServiceUtils to have common functions used in RMWebService, NMWebService and AHSWebService

          • Major - Major loss of function.
          • Open
          1.
          		 Add ability to filter the Cluster Applications API request by name Sub-task Resolved Adam Antal
          2.
          		 Pull out common code pieces from ATS v1.5 and v2 Sub-task Resolved Adam Antal
          3.
          		 Integrate the new abstract log servlet to the JobHistory server Sub-task Resolved Adam Antal
          4.
          		 Provide utility to ask whether an application is in final status Sub-task Resolved Adam Antal
          5.
          		 Support listing of aggregated logs for containers belonging to an application attempt Sub-task Resolved Adam Antal
          6.
          		 Add option to UIv2 to get container logs from the new JHS API Sub-task Resolved Adam Antal
          7.
          		 Endpoint for obtaining direct URL for the logs Sub-task Resolved Andras Gyori
          8.
          		 Add lazy initialization of LogAggregationFileControllerFactory in LogServlet Sub-task Resolved Adam Antal
          9.
          		 Create an endpoint for remote application log directory path query Sub-task Resolved Andras Gyori
          10.
          		 Create a general purpose log request with additional query parameters Sub-task Resolved Andras Gyori
          11.
          		 Remove code duplicates from log servlet utility classes Sub-task Open Adam Antal
          12.
          		 Yarn logs CLI filtering by application attempt Sub-task Resolved Hudáky Márton Gyula
          13.
          		 Add ability to provide required app information manually for log servlet Sub-task Open Adam Antal
          14.
          		 Add ability for ATS (log servlet) to read logs of running apps Sub-task Open Adam Antal
          15.
          		 Tail -f style CLI tool for extracting logs of running containers Sub-task Open Adam Antal
          16.
          		 Document the new JHS API Sub-task Open Adam Antal
          17.
          		 Implement regex querying of logs Sub-task Open Adam Antal
          18.
          		 Create simple copy log aggregation file controller Sub-task Resolved Andras Gyori
          19.
          		 HsWebServices containerlogs does not honor ACLs for completed jobs Sub-task Resolved Bence Kosztolnik
          20.
          		 HsWebServices getContainerReport uses loginUser instead of remoteUser to access ApplicationClientProtocol Sub-task Open Tarun Parimi

          Activity

            People

              adam.antal Adam Antal
              adam.antal Adam Antal
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: