Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10025 Various improvements in YARN log servlets
  3. YARN-10027

Add ability for ATS (log servlet) to read logs of running apps

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Currently neither version of the AHS is able to read logs of running apps (local logs of NodeManager). YARN log CLI is integrated with NodeManager to extract local logs as well (see YARN-5224 for reference), the same should be done for ATS.

      Some context:
      The local log files are read by the server in NMWebServices#getContainerLogFile. This is accessed by the YARN logs CLI through REST using the /containers/{containerid}/logs/{filename} endpoint in LogsCLI#getResponeFromNMWebService.

      If YARN-10026 we can pull the common code pieces out of those services, we can implement this in the common log servlet.

      Attachments

        Activity

          People

            adam.antal Adam Antal
            adam.antal Adam Antal
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: