[YARN-1253] Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode

• Type: New Feature
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.1.0-beta
• Fix Version/s: 2.3.0
• Component/s: nodemanager
• Hadoop Flags: Reviewed
• Assignee: Roman Shaposhnik
• Reporter: Alejandro Abdelnur
• Created: 30/Sep/13 17:41
• Updated: 16/Aug/14 17:28
• Resolved: 04/Oct/13 22:00

Description

When using cgroups we require LCE to be configured in the cluster to start containers.

When LCE starts containers as the user that submitted the job. While this works correctly in a secure setup, in an un-secure setup this presents a couple issues:

• LCE requires all Hadoop users submitting jobs to be Unix users in all nodes
• Because users can impersonate other users, any user would have access to any local file of other users

Particularly, the second issue is not desirable as a user could get access to ssh keys of other users in the nodes or if there are NFS mounts, get to other users data outside of the cluster.

Issue Links

• relates to: YARN-2424 LCE should support non-cgroups, non-secure mode