Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-11480

Retain all the YARN container log files in a Jenkins run

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 4.2.0
    • Infrastructure
    • None
    • ghx-label-1

    Description

      We found that currently not all the YARN container log files generated in a Jenkins run are archived because a container folder will be automatically deleted after some amount of time. Thus it would be very difficult for developers to troubleshoot failed YARN applications if the container log files of failed YARN applications are deleted.

      To retain all the YARN container log files in a Jenkins run, in yarn-site.xml we could explicitly set 'yarn.nodemanager.log.retain-seconds' to a large enough value, e.g., 86,400, assuming that each Jenkins run will be complete within 86,400 seconds (or 24 hours).

      Attachments

        Activity

          People

            fangyurao Fang-Yu Rao
            fangyurao Fang-Yu Rao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: