-
Type:
Improvement
-
Status: Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 0.22.0
-
Fix Version/s: 0.21.0
-
Component/s: None
-
Labels:None
-
Hadoop Flags:Reviewed
-
Release Note:
Right now the TrackerDistributedCacheManager do the clean up with the following code path:
TaskRunner.run() -> TrackerDistributedCacheManager.setup() -> TrackerDistributedCacheManager.getLocalCache() -> TrackerDistributedCacheManager.deleteCache()
The deletion of the cache files can take a long time and it should not be done by a task. We suggest that there should be a separate thread checking and clean up the cache files.
- is blocked by
-
MAPREDUCE-1538 TrackerDistributedCacheManager can fail because the number of subdirectories reaches system limit
-
- Closed
-