Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2443 Handling logs of long-running services on YARN
  3. YARN-2748

Upload logs in the sub-folders under the local log dir when aggregating logs

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.6.0
    • Fix Version/s: None
    • Component/s: log-aggregation
    • Labels:
      None
    • Target Version/s:

      Description

      YARN-2734 has a temporal fix to skip sub folders to avoid exception. Ideally, if the app is creating a sub folder and putting its rolling logs there, we need to upload these logs as well.

        Attachments

        1. YARN-2748.001.patch
          8 kB
          Varun Saxena
        2. YARN-2748.002.patch
          11 kB
          Varun Saxena
        3. YARN-2748.03.patch
          11 kB
          Varun Saxena
        4. YARN-2748.04.patch
          11 kB
          Varun Saxena

          Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-2734 If a sub-folder is encountered by log aggregator it results in invalid aggregated file

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                varun_saxena Varun Saxena
                Reporter:
                zjshen Zhijie Shen
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated: