Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
This happens frequently in the MiniYarnCluster setup where a job completes and then the cluster is shutdown. Often the jobs are scheduled to delay deletion of the log files so that container logs are available for debugging. A scheduled log deletion has a default value of 3 hours. When the NonAggregating LogHandler is stopped it waits 10 seconds for all delayed scheduled log deletions to occur and then shuts down.
A test developer has to make a trade of to either 1) set the log deletion to 0 to have the tests quickly shutdown but get no container logs to debug or 2) keep the log deletion at 3 hours and incur the 10 second timeout for each test suit.