Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-563 Security features for Map/Reduce
  3. MAPREDUCE-744

Support in DistributedCache to share cache files with other users after HADOOP-4493

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Fixed DistributedCache to support sharing of the local cache files with other users on the same TaskTracker. The cache files are checked at the client side for public/private access on the file system, and that information is passed in the configuration. The TaskTrackers look at the configuration for each file during task localization, and, if the file was public on the filesystem, they are localized to a common space for sharing by all users' tasks on the TaskTracker. Else the file is localized to the user's private directory on the local filesystem.
      Show
      Fixed DistributedCache to support sharing of the local cache files with other users on the same TaskTracker. The cache files are checked at the client side for public/private access on the file system, and that information is passed in the configuration. The TaskTrackers look at the configuration for each file during task localization, and, if the file was public on the filesystem, they are localized to a common space for sharing by all users' tasks on the TaskTracker. Else the file is localized to the user's private directory on the local filesystem.

      Description

      HADOOP-4493 aims to completely privatize the files distributed to TT via DistributedCache. This jira issues focuses on sharing some/all of these files with all other users.

        Attachments

        1. 744-early.patch
          22 kB
          Devaraj Das
        2. 744-1.patch
          28 kB
          Devaraj Das
        3. 744-2.patch
          28 kB
          Devaraj Das
        4. 744-3.patch
          28 kB
          Devaraj Das
        5. 744-4.patch
          30 kB
          Devaraj Das
        6. 744-5.patch
          26 kB
          Devaraj Das
        7. 744-6.patch
          26 kB
          Devaraj Das
        8. 744-6-y20.patch
          27 kB
          Hemanth Yamijala

          Issue Links

            Activity

              People

              • Assignee:
                devaraj Devaraj Das
                Reporter:
                vinodkv Vinod Kumar Vavilapalli
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: