Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: tasktracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Fixed TaskTracker and related classes so as to set correct and most restrictive access control for DistributedCache files/archives.
       - To do this, it changed the directory structure of per-job local files on a TaskTracker to the following:
      $mapred.local.dir
         `-- taskTracker
              `-- $user
                     |- distcache
                     `-- jobcache
       - Distributed cache files/archives are now user-owned by the job-owner and the group-owned by the special group-owner of the task-controller binary. The files/archives are set most private permissions possible, and as soon as possible, immediately after the files/dirs are first localized on the TT.
       - As depicted by the new directory structure, a directory corresponding to each user is created on each TT when that particular user's first task are assigned to the corresponding TT. These user directories remain on the TT forever are not cleaned when unused, which is targeted to be fixed via MAPREDUCE-1019.
       - The distributed cache files are now accessible _only_ by the user who first localized them. Sharing of these files across users is no longer possible, but is targeted for future versions via MAPREDUCE-744.
      Show
      Fixed TaskTracker and related classes so as to set correct and most restrictive access control for DistributedCache files/archives.  - To do this, it changed the directory structure of per-job local files on a TaskTracker to the following: $mapred.local.dir    `-- taskTracker         `-- $user                |- distcache                `-- jobcache  - Distributed cache files/archives are now user-owned by the job-owner and the group-owned by the special group-owner of the task-controller binary. The files/archives are set most private permissions possible, and as soon as possible, immediately after the files/dirs are first localized on the TT.  - As depicted by the new directory structure, a directory corresponding to each user is created on each TT when that particular user's first task are assigned to the corresponding TT. These user directories remain on the TT forever are not cleaned when unused, which is targeted to be fixed via MAPREDUCE-1019 .  - The distributed cache files are now accessible _only_ by the user who first localized them. Sharing of these files across users is no longer possible, but is targeted for future versions via MAPREDUCE-744 .
    1. MAPREDUCE-856-20090908-y20.txt
      151 kB
      Hemanth Yamijala
    2. MAPREDUCE-856-20090908.txt
      153 kB
      Vinod Kumar Vavilapalli
    3. MAPREDUCE-856-20090907.1.txt
      153 kB
      Vinod Kumar Vavilapalli
    4. MAPREDUCE-856-20090907.txt
      153 kB
      Vinod Kumar Vavilapalli
    5. MAPREDUCE-856-20090904.1.txt
      151 kB
      Vinod Kumar Vavilapalli
    6. MAPREDUCE-856-20090904.txt
      150 kB
      Vinod Kumar Vavilapalli
    7. MAPREDUCE-856-20090903.txt
      149 kB
      Vinod Kumar Vavilapalli
    8. MAPREDUCE-856-20090827.txt
      148 kB
      Vinod Kumar Vavilapalli
    9. MAPREDUCE-856-20090825.3.txt
      138 kB
      Vinod Kumar Vavilapalli
    10. MAPREDUCE-856-20090821.txt
      116 kB
      Vinod Kumar Vavilapalli
    11. MAPREDUCE-856-20090820.txt
      116 kB
      Vinod Kumar Vavilapalli

      Issue Links

        Activity

          People

          • Assignee:
            Vinod Kumar Vavilapalli
            Reporter:
            Arun C Murthy
          • Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development