Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8144

yarn logs organized output

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      I'm using yarn logs to gather the logs for Tez AM / llap.
      As a log for a single tez am may contain a lot of files which each correspont to single query execution - its not really usefull to just browse the log as is.
      I've tried the -out option to get an organized output; but it only separated at a "container" level.

      $ yarn logs -applicationId application_1522319554594_0065 -out asd2
      $ find asd2/ -type f
      asd2/lemon-8.openstacklocal_45454/container_e03_1522319554594_0065_01_000001
      $ grep '^End' asd2/lemon-8.openstacklocal_45454/container_e03_1522319554594_0065_01_000001|wc -l
      64
      

      I think it would be great to extend the directory output to create separate files for each output.

      Attachments

        Activity

          People

            Unassigned Unassigned
            kgyrtkirk Zoltan Haindrich
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: