Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-563 Security features for Map/Reduce
  3. MAPREDUCE-842

Per-job local data on the TaskTracker node should have right access-control

    XMLWordPrintableJSON

Details

    • Reviewed
    • Hide
      Modified TaskTracker and related classes so that per-job local data on the TaskTracker node has right access-control. Important changes:
       - All files/directories of the job on the TaskTracker are now user-owned by the job-owner and group-owner by a special TaskTracker's group.
       - The permissions of the file/directories are set to the most restrictive permissions possible.
       - Files/dirs shareable by all tasks of the job on this TT are set proper access control as soon as possible, i.e immediately after job-localization and those that are private to a single task are set access control after the corresponding task's localization.
       - Also fixes MAPREDUCE-131 which is related to a bug because of which tasks hang when the taskcontroller.cfg has multiple entries for mapred.local.dir
       - A new configuration entry hadoop.log.dir corresponding to the hadoop.log.dir in TT's configuration is now needed in task-controller.cfg so as to support restricted access control for userlogs of the tasks on the TaskTracker.
      Show
      Modified TaskTracker and related classes so that per-job local data on the TaskTracker node has right access-control. Important changes:  - All files/directories of the job on the TaskTracker are now user-owned by the job-owner and group-owner by a special TaskTracker's group.  - The permissions of the file/directories are set to the most restrictive permissions possible.  - Files/dirs shareable by all tasks of the job on this TT are set proper access control as soon as possible, i.e immediately after job-localization and those that are private to a single task are set access control after the corresponding task's localization.  - Also fixes MAPREDUCE-131 which is related to a bug because of which tasks hang when the taskcontroller.cfg has multiple entries for mapred.local.dir  - A new configuration entry hadoop.log.dir corresponding to the hadoop.log.dir in TT's configuration is now needed in task-controller.cfg so as to support restricted access control for userlogs of the tasks on the TaskTracker.

    Attachments

      1. 842.20S-4.patch
        208 kB
        Vinod Kumar Vavilapalli
      2. HADOOP-4491-20090623-common.1.txt
        24 kB
        Vinod Kumar Vavilapalli
      3. HADOOP-4491-20090623-mapred.1.txt
        104 kB
        Vinod Kumar Vavilapalli
      4. HADOOP-4491-20090703.1.txt
        136 kB
        Vinod Kumar Vavilapalli
      5. HADOOP-4491-20090703.txt
        139 kB
        Vinod Kumar Vavilapalli
      6. HADOOP-4491-20090703-common.1.txt
        23 kB
        Vinod Kumar Vavilapalli
      7. HADOOP-4491-20090703-common.txt
        23 kB
        Vinod Kumar Vavilapalli
      8. HADOOP-4491-20090707.txt
        137 kB
        Vinod Kumar Vavilapalli
      9. HADOOP-4491-20090707-common.txt
        11 kB
        Vinod Kumar Vavilapalli
      10. HADOOP-4491-20090716-mapred.txt
        134 kB
        Vinod Kumar Vavilapalli
      11. HADOOP-4491-20090803.1.txt
        170 kB
        Vinod Kumar Vavilapalli
      12. HADOOP-4491-20090803.txt
        171 kB
        Vinod Kumar Vavilapalli
      13. HADOOP-4491-20090806.txt
        190 kB
        Vinod Kumar Vavilapalli
      14. HADOOP-4491-20090807.2.txt
        194 kB
        Vinod Kumar Vavilapalli
      15. HADOOP-4491-20090810.1.txt
        201 kB
        Vinod Kumar Vavilapalli
      16. HADOOP-4491-20090810.3.txt
        201 kB
        Vinod Kumar Vavilapalli
      17. HADOOP-4491-20090811.txt
        205 kB
        Vinod Kumar Vavilapalli
      18. HADOOP-4491-20090812.txt
        205 kB
        Vinod Kumar Vavilapalli
      19. MR-842-follow-up.patch
        4 kB
        Hemanth Yamijala

      Issue Links

        Activity

          People

            vinodkv Vinod Kumar Vavilapalli
            acmurthy Arun Murthy
            Votes:
            1 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: