Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
2.7.3
-
None
-
None
Description
Currently LogAggregation deletes the application logs based on start time of the job. For long running jobs (started before yarn.log-aggregation.retain-seconds), say it is failed yesterday for some reason and we won't have the job logs today for debugging.
Better to consider the completedTime of the job as part of the deletion condition.