Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4149

yarn logs -am should provide an option to fetch all the log files

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.7.1
    • 2.8.0, 3.0.0-alpha1
    • client, nodemanager
    • None

    Description

      From Gopal Vijayaraghavan -

      Trying to collect a hanging Tez AM logs, by killing the container and running yarn logs -applicationId application_1437098194051_0178 -am ALL

      The output contains only one log file, which does not contain any of the actual execution logs, only the initialization logs.

      From YARN-3347, I note that

      // if we do not specify the value for CONTAINER_LOG_FILES option,
      // we will only output syslog

      This means that the person calling the yarn logs command has to list it out like this, to collect logs

      yarn logs -applicationId application_1437098194051_0178 -am ALL -logFiles \
      syslog_dag_1437098194051_0178_2_post,\
      dag_1437098194051_0178_2-tez-dag.pb.txt,\
      syslog_dag_1437098194051_0178_2,\
      syslog_dag_1437098194051_0178_1_post,\
      syslog_dag_1437098194051_0178_1,\
      syslog,\
      stdout,\
      stderr,\
      dag_1437098194051_0178_2.dot,\
      dag_1437098194051_0178_1.dot,\
      dag_1437098194051_0178_1-tez-dag.pb.txt

      Attachments

        1. YARN-4149.001.patch
          15 kB
          Varun Vasudev
        2. YARN-4149.002.patch
          19 kB
          Varun Vasudev
        3. YARN-4149.003.patch
          19 kB
          Varun Vasudev

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vvasudev Varun Vasudev
            vvasudev Varun Vasudev
            Votes:
            0 Vote for this issue
            Watchers:
            8 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment