Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7847

Provide permalinks for container logs

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • amrmproxy
    • None

    Description

      YARN doesn't offer a service similar to AM proxy URL for container logs even if log-aggregation is enabled. The current mechanism of having the NM redirect to yarn.log.server.url fails once the node is down. Workarounds like in MR JobHistory to rewrite URI's on the fly are possible, but do not represent a good long term solution to onboard new apps.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-23155 YARN-aggregated executor/driver logs appear unavailable when NM is down

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              jira.shegalov Gera Shegalov
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: