Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21013

Spark History Server does not show the logs of completed Yarn Jobs

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 1.6.1, 2.0.1, 2.1.0
    • None
    • Web UI

    Description

      I am facing issue when accessing the container logs of a completed Spark (Yarn) application from the History Server.

      Repro Steps:
      1) Run the spark-shell in yarn client mode. Or run Pi job in Yarn mode.
      2) Once the job is completed, (in the case of spark shell, exit after doing some simple operations), try to access the STDOUT or STDERR logs of the application from the Executors tab in the Spark History Server UI.
      3) If yarn log aggregation is enabled, then logs won't be available in node manager's log location. But history Server is trying to access the logs from the nodemanager's log location giving below error in the UI:

      Failed redirect for container_e31_1496881617682_0003_01_000002
      ResourceManager
      RM Home
      NodeManager
      Tools
      Failed while trying to construct the redirect url to the log server. Log Server url may not be configured
      java.lang.Exception: Unknown container. Container either has not started or has already completed or doesn't belong to this node at all.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            harick HARIKRISHNAN Ck
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment