Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4904 YARN Log tooling enhancements
  3. YARN-1134

Add support for zipping/unzipping logs while in transit for the NM logs web-service

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      As zjshen pointed out at YARN-649,

      For the long running applications, they may have a big log file, such that it will take a long time to download the log file via the RESTful API. Consequently, HTTP connection may timeout before downloading before downloading a complete log file. Maybe it is good to zip the log file before sending it, and unzip it after receiving it.

      Attachments

        1. YARN-1134.1.patch
          39 kB
          Xuan Gong

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-4913 Yarn logs should take a -out option to write to a directory

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-4920 ATS/NM should support a link to dowload/get the logs in text format

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-4919 Yarn logs should support a option to output logs as compressed archive

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              xgong Xuan Gong
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: