[YARN-8645] Yarn NM fail to start when remount cpu control group

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: nodemanager
• Assignee: Unassigned
• Reporter: Jiandan Yang
• Created: 10/Aug/18 03:01
• Updated: 31/Mar/22 18:52

Description

NM failed to start when we update Yarn to latest version. NM logs are as follows:

2018-08-08 16:07:01,244 INFO [main] org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.CGroupsHandlerImpl: Mounting controller cpu at /sys/fs/cgroup/cpu
2018-08-08 16:07:01,246 WARN [main] org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationExecutor: Shell execution returned exit code: 32. Privileged Execution Operation Stderr:
Feature disabled: mount cgroup

Stdout:
Full command array for failed execution:
[/home/hadoop/hadoop_hbase/hadoop-current/bin/container-executor, --mount-cgroups, hadoop-yarn, cpu,cpuset,cpuacct=/sys/fs/cgroup/cpu]
2018-08-08 16:07:01,247 ERROR [main] org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.CGroupsHandlerImpl: Failed to mount controller: cpu
2018-08-08 16:07:01,247 ERROR [main] org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Failed to bootstrap configured resource subsystems!
org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.ResourceHandlerException: Failed to mount controller: cpu
 

The cause of error is that 351cf87c92872d90f62c476f85ae4d02e485769c disable mounting cgroups by default in container-executor, which make container-executor return non-zero when executing mount-cgroups