Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1019

Stale user directories left on TTs after MAPREDUCE-856

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: None
    • Component/s: tasktracker
    • Labels:
      None

      Description

      MAPREDUCE-856 changed the directory structure of job files on the TT. As part of this, it introduced user directories under taskTracker subdirectory which contains private files of a user. The user directories are created on the TT when the user's first task is assigned to this TT. But these user-directories are never cleaned up from the TT, even when no task of this user is running on this TT. This essentially leaves empty user directories hanging around on the TT, whose number may increase over time.

      This was originally intended to be fixed in MAPREDUCE-856, but could not be done because increasing complexity already stretched that issue.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              vinodkv Vinod Kumar Vavilapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: