Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-563 Security features for Map/Reduce
  3. MAPREDUCE-744

Support in DistributedCache to share cache files with other users after HADOOP-4493

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Fixed DistributedCache to support sharing of the local cache files with other users on the same TaskTracker. The cache files are checked at the client side for public/private access on the file system, and that information is passed in the configuration. The TaskTrackers look at the configuration for each file during task localization, and, if the file was public on the filesystem, they are localized to a common space for sharing by all users' tasks on the TaskTracker. Else the file is localized to the user's private directory on the local filesystem.
      Show
      Fixed DistributedCache to support sharing of the local cache files with other users on the same TaskTracker. The cache files are checked at the client side for public/private access on the file system, and that information is passed in the configuration. The TaskTrackers look at the configuration for each file during task localization, and, if the file was public on the filesystem, they are localized to a common space for sharing by all users' tasks on the TaskTracker. Else the file is localized to the user's private directory on the local filesystem.

      Description

      HADOOP-4493 aims to completely privatize the files distributed to TT via DistributedCache. This jira issues focuses on sharing some/all of these files with all other users.

      1. 744-early.patch
        22 kB
        Devaraj Das
      2. 744-1.patch
        28 kB
        Devaraj Das
      3. 744-2.patch
        28 kB
        Devaraj Das
      4. 744-3.patch
        28 kB
        Devaraj Das
      5. 744-4.patch
        30 kB
        Devaraj Das
      6. 744-5.patch
        26 kB
        Devaraj Das
      7. 744-6.patch
        26 kB
        Devaraj Das
      8. 744-6-y20.patch
        27 kB
        Hemanth Yamijala

        Issue Links

          Activity

          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Tom White made changes -
          Fix Version/s 0.21.0 [ 12314045 ]
          Fix Version/s 0.22.0 [ 12314184 ]
          Vinod Kumar Vavilapalli made changes -
          Release Note Fixed DistributedCache to support sharing of the local cache files with other users on the same TaskTracker. The cache files are checked at the client side for public/private access on the file system, and that information is passed in the configuration. The TaskTrackers look at the configuration for each file during task localization, and, if the file was public on the filesystem, they are localized to a common space for sharing by all users' tasks on the TaskTracker. Else the file is localized to the user's private directory on the local filesystem.
          Component/s distributed-cache [ 12313271 ]
          Component/s security [ 12313041 ]
          Hemanth Yamijala made changes -
          Attachment 744-6-y20.patch [ 12431313 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Devaraj Das made changes -
          Attachment 744-6.patch [ 12428939 ]
          Boris Shkolnik made changes -
          Hadoop Flags [Reviewed]
          Devaraj Das made changes -
          Attachment 744-5.patch [ 12428884 ]
          Devaraj Das made changes -
          Attachment 744-4.patch [ 12428783 ]
          Devaraj Das made changes -
          Attachment 744-3.patch [ 12428648 ]
          Devaraj Das made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Devaraj Das made changes -
          Attachment 744-2.patch [ 12427656 ]
          Devaraj Das made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Devaraj Das [ devaraj ]
          Fix Version/s 0.22.0 [ 12314184 ]
          Devaraj Das made changes -
          Attachment 744-1.patch [ 12427588 ]
          Devaraj Das made changes -
          Attachment 744-early.patch [ 12427007 ]
          Vinod Kumar Vavilapalli made changes -
          Field Original Value New Value
          Link This issue is blocked by HADOOP-4493 [ HADOOP-4493 ]
          Vinod Kumar Vavilapalli created issue -

            People

            • Assignee:
              Devaraj Das
              Reporter:
              Vinod Kumar Vavilapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development