Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2443 Handling logs of long-running services on YARN
  3. YARN-2748

Upload logs in the sub-folders under the local log dir when aggregating logs

Add voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.6.0
    • None
    • log-aggregation
    • None

    Description

      YARN-2734 has a temporal fix to skip sub folders to avoid exception. Ideally, if the app is creating a sub folder and putting its rolling logs there, we need to upload these logs as well.

      Attachments

        1. YARN-2748.001.patch
          8 kB
          Varun Saxena
        2. YARN-2748.002.patch
          11 kB
          Varun Saxena
        3. YARN-2748.03.patch
          11 kB
          Varun Saxena
        4. YARN-2748.04.patch
          11 kB
          Varun Saxena

        Issue Links

        relates to

        Bug - A problem which impairs or prevents the functions of the product. YARN-2734 If a sub-folder is encountered by log aggregator it results in invalid aggregated file

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            varun_saxena Varun Saxena
            zjshen Zhijie Shen
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment