[MAPREDUCE-1019] Stale user directories left on TTs after MAPREDUCE-856

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.21.0
• Component/s: tasktracker
• Assignee: Unassigned
• Reporter: Vinod Kumar Vavilapalli
• Created: 22/Sep/09 07:10
• Updated: 24/Jul/14 00:14
• Resolved: 24/Jul/14 00:14

Description

MAPREDUCE-856 changed the directory structure of job files on the TT. As part of this, it introduced user directories under taskTracker subdirectory which contains private files of a user. The user directories are created on the TT when the user's first task is assigned to this TT. But these user-directories are never cleaned up from the TT, even when no task of this user is running on this TT. This essentially leaves empty user directories hanging around on the TT, whose number may increase over time.

This was originally intended to be fixed in MAPREDUCE-856, but could not be done because increasing complexity already stretched that issue.