Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: tasktracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Fixed TaskTracker and related classes so as to set correct and most restrictive access control for DistributedCache files/archives.
       - To do this, it changed the directory structure of per-job local files on a TaskTracker to the following:
      $mapred.local.dir
         `-- taskTracker
              `-- $user
                     |- distcache
                     `-- jobcache
       - Distributed cache files/archives are now user-owned by the job-owner and the group-owned by the special group-owner of the task-controller binary. The files/archives are set most private permissions possible, and as soon as possible, immediately after the files/dirs are first localized on the TT.
       - As depicted by the new directory structure, a directory corresponding to each user is created on each TT when that particular user's first task are assigned to the corresponding TT. These user directories remain on the TT forever are not cleaned when unused, which is targeted to be fixed via MAPREDUCE-1019.
       - The distributed cache files are now accessible _only_ by the user who first localized them. Sharing of these files across users is no longer possible, but is targeted for future versions via MAPREDUCE-744.
      Show
      Fixed TaskTracker and related classes so as to set correct and most restrictive access control for DistributedCache files/archives.  - To do this, it changed the directory structure of per-job local files on a TaskTracker to the following: $mapred.local.dir    `-- taskTracker         `-- $user                |- distcache                `-- jobcache  - Distributed cache files/archives are now user-owned by the job-owner and the group-owned by the special group-owner of the task-controller binary. The files/archives are set most private permissions possible, and as soon as possible, immediately after the files/dirs are first localized on the TT.  - As depicted by the new directory structure, a directory corresponding to each user is created on each TT when that particular user's first task are assigned to the corresponding TT. These user directories remain on the TT forever are not cleaned when unused, which is targeted to be fixed via MAPREDUCE-1019 .  - The distributed cache files are now accessible _only_ by the user who first localized them. Sharing of these files across users is no longer possible, but is targeted for future versions via MAPREDUCE-744 .

      Attachments

      1. MAPREDUCE-856-20090820.txt
        116 kB
        Vinod Kumar Vavilapalli
      2. MAPREDUCE-856-20090821.txt
        116 kB
        Vinod Kumar Vavilapalli
      3. MAPREDUCE-856-20090825.3.txt
        138 kB
        Vinod Kumar Vavilapalli
      4. MAPREDUCE-856-20090827.txt
        148 kB
        Vinod Kumar Vavilapalli
      5. MAPREDUCE-856-20090903.txt
        149 kB
        Vinod Kumar Vavilapalli
      6. MAPREDUCE-856-20090904.1.txt
        151 kB
        Vinod Kumar Vavilapalli
      7. MAPREDUCE-856-20090904.txt
        150 kB
        Vinod Kumar Vavilapalli
      8. MAPREDUCE-856-20090907.1.txt
        153 kB
        Vinod Kumar Vavilapalli
      9. MAPREDUCE-856-20090907.txt
        153 kB
        Vinod Kumar Vavilapalli
      10. MAPREDUCE-856-20090908.txt
        153 kB
        Vinod Kumar Vavilapalli
      11. MAPREDUCE-856-20090908-y20.txt
        151 kB
        Hemanth Yamijala

        Issue Links

          Activity

            People

            • Assignee:
              vinodkv Vinod Kumar Vavilapalli
              Reporter:
              acmurthy Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: