Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2443 Handling logs of long-running services on YARN
  3. YARN-2748

Upload logs in the sub-folders under the local log dir when aggregating logs

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.6.0
    • None
    • log-aggregation
    • None

    Description

      YARN-2734 has a temporal fix to skip sub folders to avoid exception. Ideally, if the app is creating a sub folder and putting its rolling logs there, we need to upload these logs as well.

      Attachments

        1. YARN-2748.001.patch
          8 kB
          Varun Saxena
        2. YARN-2748.002.patch
          11 kB
          Varun Saxena
        3. YARN-2748.03.patch
          11 kB
          Varun Saxena
        4. YARN-2748.04.patch
          11 kB
          Varun Saxena

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-2734 If a sub-folder is encountered by log aggregator it results in invalid aggregated file

          • Major - Major loss of function.
          • Closed

          Activity

            People

              varun_saxena Varun Saxena
              zjshen Zhijie Shen
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated: