Details
-
Task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
ghx-label-1
Description
We found that currently not all the YARN container log files generated in a Jenkins run are archived because a container folder will be automatically deleted after some amount of time. Thus it would be very difficult for developers to troubleshoot failed YARN applications if the container log files of failed YARN applications are deleted.
To retain all the YARN container log files in a Jenkins run, in yarn-site.xml we could explicitly set 'yarn.nodemanager.log.retain-seconds' to a large enough value, e.g., 86,400, assuming that each Jenkins run will be complete within 86,400 seconds (or 24 hours).