[YARN-4578] Directories that are mounted in docker containers need to be more restrictive/container-specific

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: yarn
• Labels: Docker
• Assignee: Sidharta Seethana Assign to me
• Reporter: Sidharta Seethana
• Created: 11/Jan/16 22:40
• Updated: 02/May/18 22:34
• Resolved: 22/Jan/16 09:19

Description

Currently, the "top level" log and local directories are mounted inside docker containers (see below for an example). This is not restrictive enough - we need to ensure that only container specific directories are mounted.

/dev/sda4 on /grid/0/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
/dev/sda4 on /grid/0/hadoop/yarn/local/usercache/root/appcache/application_1451931954322_0020/container_e50_1451931954322_0020_01_000002 type ext4 (rw,relatime,data=ordered)
/dev/sda4 on /grid/0/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
/dev/sdb1 on /grid/1/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
/dev/sdb1 on /grid/1/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
/dev/sdc1 on /grid/2/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
/dev/sdc1 on /grid/2/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
/dev/sdd1 on /grid/3/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
/dev/sdd1 on /grid/3/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
/dev/sde1 on /grid/4/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
/dev/sde1 on /grid/4/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
/dev/sdf1 on /grid/5/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
/dev/sdf1 on /grid/5/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)