Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-563 Security features for Map/Reduce
  3. MAPREDUCE-842

Per-job local data on the TaskTracker node should have right access-control

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed
    • Hide
      Modified TaskTracker and related classes so that per-job local data on the TaskTracker node has right access-control. Important changes:
       - All files/directories of the job on the TaskTracker are now user-owned by the job-owner and group-owner by a special TaskTracker's group.
       - The permissions of the file/directories are set to the most restrictive permissions possible.
       - Files/dirs shareable by all tasks of the job on this TT are set proper access control as soon as possible, i.e immediately after job-localization and those that are private to a single task are set access control after the corresponding task's localization.
       - Also fixes MAPREDUCE-131 which is related to a bug because of which tasks hang when the taskcontroller.cfg has multiple entries for mapred.local.dir
       - A new configuration entry hadoop.log.dir corresponding to the hadoop.log.dir in TT's configuration is now needed in task-controller.cfg so as to support restricted access control for userlogs of the tasks on the TaskTracker.
      Show
      Modified TaskTracker and related classes so that per-job local data on the TaskTracker node has right access-control. Important changes:  - All files/directories of the job on the TaskTracker are now user-owned by the job-owner and group-owner by a special TaskTracker's group.  - The permissions of the file/directories are set to the most restrictive permissions possible.  - Files/dirs shareable by all tasks of the job on this TT are set proper access control as soon as possible, i.e immediately after job-localization and those that are private to a single task are set access control after the corresponding task's localization.  - Also fixes MAPREDUCE-131 which is related to a bug because of which tasks hang when the taskcontroller.cfg has multiple entries for mapred.local.dir  - A new configuration entry hadoop.log.dir corresponding to the hadoop.log.dir in TT's configuration is now needed in task-controller.cfg so as to support restricted access control for userlogs of the tasks on the TaskTracker.

    Attachments

      1. MR-842-follow-up.patch
        4 kB
        Hemanth Yamijala
      2. HADOOP-4491-20090812.txt
        205 kB
        Vinod Kumar Vavilapalli
      3. HADOOP-4491-20090811.txt
        205 kB
        Vinod Kumar Vavilapalli
      4. HADOOP-4491-20090810.3.txt
        201 kB
        Vinod Kumar Vavilapalli
      5. HADOOP-4491-20090810.1.txt
        201 kB
        Vinod Kumar Vavilapalli
      6. HADOOP-4491-20090807.2.txt
        194 kB
        Vinod Kumar Vavilapalli
      7. HADOOP-4491-20090806.txt
        190 kB
        Vinod Kumar Vavilapalli
      8. HADOOP-4491-20090803.txt
        171 kB
        Vinod Kumar Vavilapalli
      9. HADOOP-4491-20090803.1.txt
        170 kB
        Vinod Kumar Vavilapalli
      10. HADOOP-4491-20090716-mapred.txt
        134 kB
        Vinod Kumar Vavilapalli
      11. HADOOP-4491-20090707-common.txt
        11 kB
        Vinod Kumar Vavilapalli
      12. HADOOP-4491-20090707.txt
        137 kB
        Vinod Kumar Vavilapalli
      13. HADOOP-4491-20090703-common.txt
        23 kB
        Vinod Kumar Vavilapalli
      14. HADOOP-4491-20090703-common.1.txt
        23 kB
        Vinod Kumar Vavilapalli
      15. HADOOP-4491-20090703.txt
        139 kB
        Vinod Kumar Vavilapalli
      16. HADOOP-4491-20090703.1.txt
        136 kB
        Vinod Kumar Vavilapalli
      17. HADOOP-4491-20090623-mapred.1.txt
        104 kB
        Vinod Kumar Vavilapalli
      18. HADOOP-4491-20090623-common.1.txt
        24 kB
        Vinod Kumar Vavilapalli
      19. 842.20S-4.patch
        208 kB
        Vinod Kumar Vavilapalli

      Issue Links

      Activity

        This comment will be Viewable by All Users Viewable by All Users
        Cancel

        People

          vinodkv Vinod Kumar Vavilapalli
          acmurthy Arun Murthy
          Votes:
          1 Vote for this issue
          Watchers:
          10 Start watching this issue

          Dates

            Created:
            Updated:
            Resolved:

            Slack

              Issue deployment