Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-563 Security features for Map/Reduce
  3. MAPREDUCE-744

Support in DistributedCache to share cache files with other users after HADOOP-4493

    XMLWordPrintableJSON

Details

    • Reviewed
    • Hide
      Fixed DistributedCache to support sharing of the local cache files with other users on the same TaskTracker. The cache files are checked at the client side for public/private access on the file system, and that information is passed in the configuration. The TaskTrackers look at the configuration for each file during task localization, and, if the file was public on the filesystem, they are localized to a common space for sharing by all users' tasks on the TaskTracker. Else the file is localized to the user's private directory on the local filesystem.
      Show
      Fixed DistributedCache to support sharing of the local cache files with other users on the same TaskTracker. The cache files are checked at the client side for public/private access on the file system, and that information is passed in the configuration. The TaskTrackers look at the configuration for each file during task localization, and, if the file was public on the filesystem, they are localized to a common space for sharing by all users' tasks on the TaskTracker. Else the file is localized to the user's private directory on the local filesystem.

    Description

      HADOOP-4493 aims to completely privatize the files distributed to TT via DistributedCache. This jira issues focuses on sharing some/all of these files with all other users.

      Attachments

        1. 744-early.patch
          22 kB
          Devaraj Das
        2. 744-6-y20.patch
          27 kB
          Hemanth Yamijala
        3. 744-6.patch
          26 kB
          Devaraj Das
        4. 744-5.patch
          26 kB
          Devaraj Das
        5. 744-4.patch
          30 kB
          Devaraj Das
        6. 744-3.patch
          28 kB
          Devaraj Das
        7. 744-2.patch
          28 kB
          Devaraj Das
        8. 744-1.patch
          28 kB
          Devaraj Das

        Issue Links

          Activity

            People

              ddas Devaraj Das
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: