[YARN-6433] Only accessible cgroup mount directories should be selected for a controller

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha4
• Fix Version/s: 2.9.0, 3.0.0-alpha4
• Component/s: nodemanager
• Hadoop Flags: Reviewed
• Assignee: Miklos Szegedi
• Reporter: Miklos Szegedi
• Created: 04/Apr/17 03:02
• Updated: 19/Apr/17 23:34
• Resolved: 14/Apr/17 22:10

Description

I have a Ubuntu16 box that returns the following error with pre-mounted cgroups on the latest trunk:

2017-04-03 19:42:18,511 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.CGroupsHandlerImpl: Cgroups not accessible /run/lxcfs/controllers/cpu,cpuacct

The version is:

$ uname -a
Linux mybox 4.4.0-24-generic #43-Ubuntu SMP Wed Jun 8 19:27:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

The following cpu cgroup filesystems are mounted:

$ grep cpuacct /etc/mtab
cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct,nsroot=/ 0 0
cpu,cpuacct /run/lxcfs/controllers/cpu,cpuacct cgroup rw,relatime,cpu,cpuacct,nsroot=/ 0 0

/sys/fs/cgroup is accessible to my yarn user, so it should be selected instead of /run/lxcfs/controllers

Issue Links

• is related to: YARN-6500 Do not mount inaccessible cgroups directories in CgroupsLCEResourcesHandler